-- Logs begin at Mon 2022-06-27 20:26:08 UTC, end at Mon 2022-06-27 21:34:09 UTC. -- Jun 27 21:07:15.949196 dv-cinder-847732-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 27 21:07:15.959495 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 27 21:07:15.961629 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 27 21:07:15 2022] *** Jun 27 21:07:15.961629 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 27 21:07:15.961629 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 27 21:07:15.961629 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: nodename: dv-cinder-847732-1-iscsi Jun 27 21:07:15.961629 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: machine: x86_64 Jun 27 21:07:15.961629 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: clock source: unix Jun 27 21:07:15.961629 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: pcre jit disabled Jun 27 21:07:15.961629 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: detected number of CPU cores: 4 Jun 27 21:07:15.961629 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: current working directory: / Jun 27 21:07:15.961629 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: detected binary path: /usr/bin/uwsgi-core Jun 27 21:07:15.961629 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: your processes number limit is 47680 Jun 27 21:07:15.961629 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: your memory page size is 4096 bytes Jun 27 21:07:15.961629 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: detected max file descriptor number: 2048 Jun 27 21:07:15.961629 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: lock engine: pthread robust mutexes Jun 27 21:07:15.962587 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: thunder lock: enabled Jun 27 21:07:15.962587 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 27 21:07:15.962587 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 27 21:07:16.005477 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: Python main interpreter initialized at 0x564f517749c0 Jun 27 21:07:16.005477 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: python threads support enabled Jun 27 21:07:16.005477 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: your server socket listen backlog is limited to 100 connections Jun 27 21:07:16.005477 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: your mercy for graceful operations on workers is 90 seconds Jun 27 21:07:16.005903 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: mapped 403077 bytes (393 KB) for 2 cores Jun 27 21:07:16.005903 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: *** Operational MODE: preforking *** Jun 27 21:07:16.006127 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: *** uWSGI is running in multiple interpreter mode *** Jun 27 21:07:16.006127 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: spawned uWSGI master process (pid: 103347) Jun 27 21:07:16.006384 dv-cinder-847732-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 27 21:07:16.007918 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: spawned uWSGI worker 1 (pid: 103348, cores: 1) Jun 27 21:07:16.007918 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: spawned uWSGI worker 2 (pid: 103349, cores: 1) Jun 27 21:07:16.008107 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 27 21:07:16.658633 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 21:07:16.667937 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 21:07:17.768334 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 21:07:17.768334 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: from cryptography.utils import int_from_bytes Jun 27 21:07:17.769005 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 21:07:17.769005 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: from cryptography.utils import int_from_bytes Jun 27 21:07:17.769174 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 21:07:17.769174 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: from cryptography.utils import int_from_bytes Jun 27 21:07:17.769174 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 21:07:17.769174 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: from cryptography.utils import int_from_bytes Jun 27 21:07:20.260402 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 21:07:20.261080 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 21:07:20.261457 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 21:07:20.261552 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 21:07:20.261552 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 21:07:20.261701 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 21:07:20.261806 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 21:07:20.261903 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 21:07:20.261903 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 21:07:20.262053 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 21:07:20.262138 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.262224 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.262444 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.262587 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.262761 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.262915 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.263060 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.263195 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.263365 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.263467 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.263704 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.263846 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.264013 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.264161 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.264342 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.264485 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.264665 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.264808 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.264953 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.265121 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.265215 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.265304 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.265548 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847732-1-iscsi {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.265694 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847732-1-iscsi {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.265873 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.266017 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.266183 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.266324 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.266462 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.266560 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.266858 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.267004 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.267100 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.267187 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.267387 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.267503 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.267686 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.267776 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.268176 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.268289 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.269453 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.269602 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.269602 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.269796 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.269796 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.270002 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.270097 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.270193 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.270273 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.270357 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.270442 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.270529 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.270529 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.270739 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.270829 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.270919 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.271004 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.271095 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.271315 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.271445 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.271722 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847732-1-iscsi {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.271835 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847732-1-iscsi {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.272033 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.272119 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.272791 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.272912 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.272912 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.273113 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.273188 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.273297 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.273378 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.273468 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.273687 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.273781 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.274002 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.274096 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.274322 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.274415 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.274623 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.274714 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.274945 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.275053 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.275263 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.275358 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.275576 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.275668 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.275891 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.276019 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.276189 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.276280 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.276491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.276582 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.276796 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.276882 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.277137 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.277231 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.277437 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.277534 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.277737 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.277829 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.277983 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.278073 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.278286 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.278372 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.278602 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.278699 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.278920 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.279020 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.279234 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.279331 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.279480 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.279572 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.279725 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.279817 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.280041 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.280126 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.280355 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.280440 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.280668 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.280754 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.280988 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.281078 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.281294 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.281391 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.281594 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.281692 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.281896 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.281988 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.282197 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.282291 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.282495 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.282592 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.282798 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.282889 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.283109 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.283200 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.283422 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.283515 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.283737 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.283823 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.284039 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.284124 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.284356 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.284491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.284746 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.284841 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.285016 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.285113 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.285328 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.285469 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.285658 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.285755 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.285971 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.286116 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.286258 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.286405 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.286574 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.286708 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.286888 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.287029 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.287176 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.287308 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.287477 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.287611 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.287777 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.287987 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.288168 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.288372 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.288757 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.288856 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.289054 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.289155 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.289248 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.289328 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.289406 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.289489 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.289597 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.289689 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.289911 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.289996 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.290217 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.290302 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.290517 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.290617 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.290819 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.290910 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.291114 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.291206 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.291418 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.291518 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.291717 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.291810 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.292018 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.292103 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.292317 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.292415 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.292621 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.292712 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.292963 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.293051 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.293244 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.293341 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.293552 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.293637 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.293852 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.293943 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.294165 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.294250 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.294479 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.294611 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.294782 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.294867 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.295088 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.295172 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.295400 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.295537 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.295707 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.295789 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.295982 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.296081 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.296282 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.296372 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.296580 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.296664 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.296895 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.297058 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.297224 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.297309 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.297528 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.297619 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.297850 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.297941 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.298147 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.298232 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.298449 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.298533 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.298764 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.298855 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.299064 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.299171 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.299363 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.299463 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.299677 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.299764 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.299981 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.300073 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.300284 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.300377 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.300585 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.300677 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.300884 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.301002 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.301211 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.301311 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.301513 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.301599 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.301813 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.301918 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.302110 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.302209 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.302407 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.302499 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.302719 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.302817 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.303033 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.303131 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.303337 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.303434 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.303662 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.303746 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.303967 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.304056 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.304283 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.304370 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:20.304628 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.304778 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.304976 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.305111 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.305325 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.305457 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.305631 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.305769 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.305959 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.306102 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.306290 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.306430 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.306607 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.306737 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.306918 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.307045 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.307229 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.307364 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.307552 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.307696 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.307861 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.308004 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.308171 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.308300 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.308480 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.308624 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.308796 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.308957 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.309172 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.309335 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.309464 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.309551 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.309778 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.309863 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.310091 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.310176 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.310407 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.310501 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.310716 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.310800 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.311029 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.311113 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.311355 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.311453 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.311672 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.311772 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.311982 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.312083 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.312316 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.312414 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.312657 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.312751 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.312985 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.313073 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.313311 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.313405 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.313628 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.313713 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.313938 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.314021 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.314247 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.314341 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.314559 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.314645 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.314879 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.314983 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.315205 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.315290 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.315513 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.315604 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.315828 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.315915 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.316134 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.316219 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.316444 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.316529 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.316752 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.316836 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.317082 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.317169 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.317391 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.317484 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.317724 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.317894 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.318037 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.318122 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.318345 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.318431 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.318653 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.318752 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.318967 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.319062 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.319353 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.319743 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.319743 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.319903 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.319984 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.320061 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.320213 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.320309 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.320512 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.320613 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.320812 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.320899 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.321143 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.321230 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.321446 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.321545 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.321764 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.321848 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.322090 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.322185 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.322399 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.322484 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.322718 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.322805 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.323023 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.323114 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.323329 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.323421 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.323637 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.323730 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.323945 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.324029 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.324249 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.324334 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.324561 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.324663 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.324867 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.325006 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.325195 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.325282 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.325517 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.325608 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.325827 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.325920 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.326132 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.326224 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.326450 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.326534 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.326753 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.326848 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.327056 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.327140 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.327364 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.327447 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.327672 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.327766 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.327979 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.328063 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.328287 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.328380 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.328593 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.328690 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.328912 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.329054 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.329247 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.329348 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.329555 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.329651 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.329886 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.329970 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.330215 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.330301 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.330526 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.330611 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.330847 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.330939 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.331167 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.331260 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.331479 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.331565 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.331780 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.331865 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.332103 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.332239 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.332388 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.332479 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.332693 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.332782 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.333020 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.333128 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.333329 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.333415 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.333630 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.333715 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.333931 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.334024 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.334231 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.334317 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.334534 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.334628 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.334924 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.335353 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.335353 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.335523 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.335523 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.335675 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.335755 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.335842 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.336050 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.336138 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.336354 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.336447 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.336696 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.336796 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.337025 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.337112 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.337370 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.337457 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.337710 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.337802 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.338025 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.338111 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.338345 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.338430 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.338654 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.338742 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.338965 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.339049 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.339273 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.339367 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.339578 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.339677 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.339884 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.339970 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.340188 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.340281 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.340507 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.340592 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.340815 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.340917 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.341155 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.341259 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.341464 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.341550 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.341786 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.341870 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.342092 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.342185 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.342408 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.342494 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.342706 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.342824 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.343019 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.343118 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.343353 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.343446 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.343683 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.343768 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.343994 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.344086 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.344312 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.344396 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.344617 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.344700 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.344945 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.345074 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.345255 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.345340 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.345562 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.345658 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.345868 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.345954 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.346174 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.346265 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.346485 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.346576 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.346792 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.346879 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.347106 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.347191 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.347411 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.347864 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.348090 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.348177 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.348395 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.348479 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.348706 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.348804 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.349039 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.349128 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.349354 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.349439 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.349677 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.349779 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.350008 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.350093 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.350333 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.350463 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.350981 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.351093 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.351178 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.351257 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.351336 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.351482 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.351624 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.351792 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.351935 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.352105 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.352240 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.352414 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.352547 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.352716 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.352824 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.353058 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.353153 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.353373 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.353474 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.353681 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.353767 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.353986 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.354073 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.354287 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.354383 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.354606 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.354701 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.354913 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.355007 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.355213 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.355315 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.355515 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.355602 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.355824 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.355909 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.356133 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.356228 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.356437 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.356529 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.356753 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.356846 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.357079 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.357180 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.357386 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.357472 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.357689 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.357776 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.358002 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.358089 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.358304 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.358390 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.358603 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.358687 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.358900 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.358994 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.359199 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.359283 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.359535 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.359629 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.359837 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.359923 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.360135 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.360220 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.360450 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.360545 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.360759 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.360852 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.361089 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.361178 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.361401 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.361508 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.361706 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.361792 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.362014 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.362100 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.362329 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.362444 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.362640 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.362735 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.362944 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.363027 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.363252 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.363347 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.363558 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.363644 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.363866 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.363954 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.364171 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.364263 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.364485 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.364579 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.364786 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.364871 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.365119 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.365206 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.365423 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.365517 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.365719 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.365804 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.366050 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.366145 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.366370 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.366628 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.366934 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.367031 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.367262 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.367349 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.367573 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.367659 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.367888 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.367984 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.368202 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.368288 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.368513 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.368599 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.368839 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.368956 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.369193 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.369281 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.369499 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.369594 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.369810 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.369906 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.370115 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.370211 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.370416 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.370503 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.370721 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.370807 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.371023 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.371189 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.371321 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.371407 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.371622 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.371715 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.371921 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.372015 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.372220 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.372307 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.372519 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.372605 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.372826 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.372963 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.373151 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.373237 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.373450 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.373535 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.373755 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.373857 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.374054 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.374155 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.374359 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.374463 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.374656 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.374743 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.374973 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.375065 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.375275 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.375404 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.375576 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.375663 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.375872 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.375957 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.376174 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.376272 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.376501 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.376598 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.376801 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.376895 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.377161 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.377263 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.377487 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.377574 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.377795 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.377888 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.378102 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.378198 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.378402 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.378489 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.378710 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.378796 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.379009 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.379104 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.379308 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.379394 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.379606 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.379693 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.379911 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.380007 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.380212 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.380298 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.380510 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.380597 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.380816 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.380902 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.381145 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.381231 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.381451 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.381536 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.381799 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.381897 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.382095 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.382181 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.382404 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.382521 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.382707 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.382823 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.383022 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.383122 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.383329 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.383427 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.383626 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.383722 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.383924 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.384010 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.384229 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.384324 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.384532 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.384627 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.384831 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.384916 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.385157 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.385255 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.385456 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.385550 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.385759 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.385844 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.386059 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.386152 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.386359 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.386443 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.386655 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.386746 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.386960 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.387060 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.387258 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.387343 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.387555 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.387647 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.387874 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.387960 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.388173 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.388264 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.388469 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.388552 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.388770 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.388856 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.389093 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.389218 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.389395 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.389523 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.389703 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.389827 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.390022 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.390136 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.390335 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.390454 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.390639 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.390767 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.390947 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.391068 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.391249 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.391373 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.391553 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.391672 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.391855 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.391972 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.392159 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.392262 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.392459 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.392551 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.392760 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.392846 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.393088 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.393260 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.393399 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.393542 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.393677 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.393810 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.393983 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.394138 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.394272 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.394406 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.394578 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.394713 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.394880 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.395014 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.395180 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.395315 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.395478 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.395617 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.395810 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.395898 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.396110 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.396196 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.396458 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.396553 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.396760 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.396856 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.397096 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.397198 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.397440 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.397853 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.397975 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.398059 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.398138 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.398336 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.398430 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.398640 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.398740 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.398951 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.399037 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.399258 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.399352 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.399569 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.399665 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.399870 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.399956 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.400170 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.400263 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.400488 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.400582 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.400795 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.400881 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.401128 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.401226 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.401443 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.401541 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.401763 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.401855 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.402080 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.402165 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.402381 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.402466 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.402685 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.402778 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.402989 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.403086 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.403296 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.403391 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.403601 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.403704 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.403903 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.403998 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.404207 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.404299 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.404515 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.404600 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.404821 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.404915 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.405154 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.405241 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.405462 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.405547 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.405764 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.405861 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.406070 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.406164 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.406373 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.406464 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.406674 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.406759 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.406993 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.407079 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.407299 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.407384 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.407598 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.407684 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.407906 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.407992 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.408207 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.408292 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.408514 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.408599 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.408813 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.408897 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.409270 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.409408 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.409575 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.409662 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.409881 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.409974 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.410183 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.410276 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.410485 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.410570 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.410790 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.410875 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.411103 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.411198 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.411413 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.411504 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.411714 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.411807 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.412124 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.412225 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.412429 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.412515 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.412736 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.412837 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.413159 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.413634 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.413729 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.413824 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.413904 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.413982 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.414069 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.414194 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.414365 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.414518 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.414668 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.414824 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.414971 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.415128 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.415272 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.415430 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.415595 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.415751 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.415898 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.416053 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.416218 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.416371 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.416631 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.416784 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.416962 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.417121 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.417271 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.417425 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.417685 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.417842 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.417998 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.418153 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.418306 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.418463 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.418626 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.418784 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.418946 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.419104 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.419267 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.419428 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.419569 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.419734 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.419880 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.420046 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.420187 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.420356 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.420507 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.420678 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.420832 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.421022 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.421168 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.421332 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.421481 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.421646 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.421784 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.421951 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.422107 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.422275 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.422428 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.422598 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.422739 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.422911 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.423060 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.423231 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.423470 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.423645 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.423790 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.423972 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.424098 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.424287 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.424427 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.424607 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.424750 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.424967 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.425083 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.425256 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.425386 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.425559 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.425696 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.425868 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.425999 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.426175 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.426304 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.426479 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.426627 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.426802 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.426932 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.427110 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.427244 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.427419 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.427553 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.427728 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.427861 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.428041 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.428164 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.428346 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.428489 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.428677 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.428838 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.429020 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.429234 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.429335 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.429465 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.429634 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.429781 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.429946 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.430102 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.430267 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.430425 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.430591 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.430730 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.430897 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.431056 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.431219 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.431366 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.431529 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.431670 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.431834 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.431975 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.432191 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.432287 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.432444 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.432605 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.432785 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.433101 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.433272 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.433365 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.433435 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.433571 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.433776 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.433960 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.434127 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.434217 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.434458 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.434556 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.434794 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.434890 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.435130 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.435226 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.435442 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.435529 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.435759 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.435846 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.436059 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.436144 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.436361 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.436447 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.436663 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.436749 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.436994 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.437096 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.437302 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.437399 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.437605 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.437727 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.437912 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.438005 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.438213 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.438307 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.438514 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.438599 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.438811 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.438896 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.439111 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.439242 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.439421 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.439506 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.439721 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.439805 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.440036 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.440130 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.440342 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.440429 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.440643 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.440728 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.440959 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.441047 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.441270 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.441355 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.441595 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.441680 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.441904 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.441990 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.442230 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.442315 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.442544 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.442629 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.442864 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.442959 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.443168 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.443254 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.443486 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.443570 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.443798 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.443884 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.444172 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.444303 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.444808 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.444979 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.445066 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.445145 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.445223 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.445301 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.445415 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.445511 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.445729 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.445823 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.446036 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.446170 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.446343 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.446511 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.446654 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.446739 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.446965 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.447050 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.447283 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.447499 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.447832 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.447918 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.448143 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.448235 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.448457 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.448544 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.448768 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.448862 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.449106 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.449194 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.449418 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.449505 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.449730 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.449813 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.450037 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.450121 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.450347 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.450440 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.450654 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.450740 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.450965 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.451063 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.451287 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.451379 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.451607 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.451699 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.451931 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.452026 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.452243 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.452335 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.452556 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.452645 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.452870 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.452989 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.453208 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.453292 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.453524 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.453609 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.453861 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.453948 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.454166 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.454251 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.454469 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.454562 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.454785 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.454868 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.455099 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.455186 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.455404 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.455502 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.455711 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.455797 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.456019 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.456102 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.456328 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.456421 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.456638 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.456724 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.456962 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.457050 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.457277 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.457409 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.457588 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.457674 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.457903 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.457988 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.458226 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.458313 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.458543 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.458617 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.458855 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.458941 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.459167 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.459253 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.459479 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.459563 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.459825 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.460114 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.460342 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.460443 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.460665 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.460803 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.461007 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.461176 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.461333 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.461505 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.461649 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.461832 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.461963 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.462152 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.462289 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.462470 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.462598 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.462797 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.462903 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.463104 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.463212 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.463410 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.463522 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.463723 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.463817 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.464032 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.464138 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.464338 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.464433 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.464660 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.464765 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.464991 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.465125 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.465297 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.465386 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.465619 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.465867 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.465955 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.466224 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.466451 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.466537 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.466799 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.466894 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.467114 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.467200 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.467441 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.467535 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.467766 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.467854 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.468088 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.468172 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.468393 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.468477 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.468698 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.468785 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.469035 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.469123 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.469343 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.469440 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.469646 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.469732 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.469952 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.470045 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.470254 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.470339 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.470556 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.470643 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.470862 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.470955 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.471169 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.471263 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.471469 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.471563 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.471774 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.471860 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.472079 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.472172 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.472380 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.472823 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.473076 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.473167 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.473380 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.473476 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.473680 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.473773 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.473984 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.474071 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.474342 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.474450 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.474578 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.474664 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.474879 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.474965 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.475178 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.475277 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.475641 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.476046 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.476134 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.476214 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.476302 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.476383 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.476469 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.476592 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.476762 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.476900 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.477139 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.477232 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.477464 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.477568 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.477770 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.477869 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.478071 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.478168 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.478386 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.478482 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.478695 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.478783 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.479018 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.479107 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.479330 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.479420 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.479641 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.479737 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.479949 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.480042 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.480260 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.480349 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.480606 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.480801 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.480955 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.481159 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.481481 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.481588 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.481801 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.481897 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.482118 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.482204 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.482419 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.482514 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.482722 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.482820 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.483023 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.483112 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.483345 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.483446 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.483647 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.483737 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.483952 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.484039 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.484265 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.484353 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.484575 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.484669 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.484879 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.484993 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.485217 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.485325 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.485524 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.485614 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.485831 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.485918 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.486138 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.486234 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.486443 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.486529 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.486752 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.486885 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.487059 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.487209 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.487369 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.487502 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.487676 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.487810 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.487989 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.488126 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.488302 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.488435 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.488640 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.488769 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.488974 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.489080 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.489293 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.489381 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.489601 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.489688 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.489908 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.489997 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.490215 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.490303 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.490522 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.490610 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.490832 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.490920 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.491168 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.491271 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.491482 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.491601 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.491786 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.491878 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.492109 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.492197 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.492413 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.492504 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.492806 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.492882 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.493154 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.493233 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.493466 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.493556 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.493784 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.493860 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.494095 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.494180 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.494433 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.494511 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.494805 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.494900 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.495065 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.495149 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.495394 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.495491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.495706 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.495849 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.496033 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.496250 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.496401 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.496540 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.496690 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.496818 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.496973 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.497061 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.497241 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.497332 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.497550 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.497637 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.497880 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.498028 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.498173 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.498262 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.498475 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.498562 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.498778 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.498875 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.499088 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.499176 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.499390 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.499484 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.499691 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.499787 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.499992 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.500085 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.500292 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.500378 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.500595 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.500682 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.500897 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.501011 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.501224 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.501313 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.501524 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.501618 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.501824 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.501920 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.502125 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.502212 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.502423 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.502511 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.502735 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.502824 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.503027 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.503113 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.503333 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.503421 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.503636 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.503730 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.503937 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.504032 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.504243 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.504330 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.504546 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.504634 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.504850 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.504975 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.505209 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.505296 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.505531 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.505618 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.505843 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.505948 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.506166 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.506365 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.506459 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.506540 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.506837 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.506971 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.507150 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.507236 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.507477 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.507633 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.507802 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.507951 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.508127 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.508288 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.508436 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.508601 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.508769 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.508917 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.509107 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.509253 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.509421 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.509553 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.509733 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.509862 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.510045 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.510175 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.510355 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.510503 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.510667 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.510827 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.510993 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.511134 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.511319 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.511460 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.511625 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.511776 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.511954 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.512097 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.512271 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.512441 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.512592 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.512712 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.512908 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.513067 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.513238 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.513379 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.513568 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.513688 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.513879 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.514002 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.514190 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.514314 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.514507 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.514625 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.514816 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.514940 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.515128 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.515254 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.515444 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.515581 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.515761 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.515906 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.516090 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.516216 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.516422 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.516542 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.516732 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.516841 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.517133 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.517233 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.517408 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.517495 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.517752 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.517851 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.518072 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.518173 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.518420 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.518523 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.518742 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.518838 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.519048 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.519135 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.519289 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 21:07:20.519376 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.519647 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:20.519888 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 21:07:20.580716 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO dbcounter [None req-5b7691a6-2c22-4995-a977-a3b1adde2ec5 None None] Registered counter for database nova_api Jun 27 21:07:20.580986 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO dbcounter [None req-f35184bf-bd1c-4620-bb40-3520d4fb6faf None None] Registered counter for database nova_api Jun 27 21:07:20.696493 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_db.sqlalchemy.engines [None req-f35184bf-bd1c-4620-bb40-3520d4fb6faf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:07:20.699028 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG oslo_db.sqlalchemy.engines [None req-5b7691a6-2c22-4995-a977-a3b1adde2ec5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:07:20.703316 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writer thread running {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:07:20.706117 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writer thread running {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:07:20.760875 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.context [None req-f35184bf-bd1c-4620-bb40-3520d4fb6faf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9a1fe3d3-e727-4f8a-bdfc-0659bc10e814(cell1) {{(pid=103348) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 21:07:20.762588 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.context [None req-5b7691a6-2c22-4995-a977-a3b1adde2ec5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9a1fe3d3-e727-4f8a-bdfc-0659bc10e814(cell1) {{(pid=103349) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 21:07:20.764871 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-f35184bf-bd1c-4620-bb40-3520d4fb6faf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:07:20.766466 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-f35184bf-bd1c-4620-bb40-3520d4fb6faf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:07:20.766602 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-5b7691a6-2c22-4995-a977-a3b1adde2ec5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:07:20.767314 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-f35184bf-bd1c-4620-bb40-3520d4fb6faf None None] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:07:20.768098 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-5b7691a6-2c22-4995-a977-a3b1adde2ec5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:07:20.768888 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-5b7691a6-2c22-4995-a977-a3b1adde2ec5 None None] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:07:20.769337 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-f35184bf-bd1c-4620-bb40-3520d4fb6faf None None] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:07:20.770962 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG oslo_concurrency.lockutils [None req-5b7691a6-2c22-4995-a977-a3b1adde2ec5 None None] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:07:20.771333 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO dbcounter [None req-f35184bf-bd1c-4620-bb40-3520d4fb6faf None None] Registered counter for database nova_cell0 Jun 27 21:07:20.773004 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO dbcounter [None req-5b7691a6-2c22-4995-a977-a3b1adde2ec5 None None] Registered counter for database nova_cell0 Jun 27 21:07:20.776173 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO dbcounter [None req-f35184bf-bd1c-4620-bb40-3520d4fb6faf None None] Registered counter for database nova_cell1 Jun 27 21:07:20.777104 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO dbcounter [None req-5b7691a6-2c22-4995-a977-a3b1adde2ec5 None None] Registered counter for database nova_cell1 Jun 27 21:07:20.784603 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_db.sqlalchemy.engines [None req-f35184bf-bd1c-4620-bb40-3520d4fb6faf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:07:20.787797 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_db.sqlalchemy.engines [None req-f35184bf-bd1c-4620-bb40-3520d4fb6faf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:07:20.787992 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG oslo_db.sqlalchemy.engines [None req-5b7691a6-2c22-4995-a977-a3b1adde2ec5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:07:20.791034 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG oslo_db.sqlalchemy.engines [None req-5b7691a6-2c22-4995-a977-a3b1adde2ec5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:07:20.794914 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writer thread running {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:07:20.795071 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writer thread running {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:07:20.796389 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writer thread running {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:07:20.938901 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writer thread running {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:07:20.949167 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO dbcounter [None req-5b7691a6-2c22-4995-a977-a3b1adde2ec5 None None] Registered counter for database nova_cell0 Jun 27 21:07:20.958191 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG oslo_db.sqlalchemy.engines [None req-5b7691a6-2c22-4995-a977-a3b1adde2ec5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:07:20.958376 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO dbcounter [None req-f35184bf-bd1c-4620-bb40-3520d4fb6faf None None] Registered counter for database nova_cell0 Jun 27 21:07:20.963365 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writer thread running {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:07:20.967795 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_db.sqlalchemy.engines [None req-f35184bf-bd1c-4620-bb40-3520d4fb6faf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:07:20.972869 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writer thread running {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:07:21.297576 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: WARNING keystonemiddleware.auth_token [None req-f35184bf-bd1c-4620-bb40-3520d4fb6faf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 21:07:21.301729 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: WARNING keystonemiddleware.auth_token [None req-5b7691a6-2c22-4995-a977-a3b1adde2ec5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 21:07:21.305127 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: WARNING keystonemiddleware.auth_token [None req-f35184bf-bd1c-4620-bb40-3520d4fb6faf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 21:07:21.309473 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: WARNING keystonemiddleware.auth_token [None req-5b7691a6-2c22-4995-a977-a3b1adde2ec5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 21:07:21.647419 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: WARNING keystonemiddleware.auth_token [None req-f35184bf-bd1c-4620-bb40-3520d4fb6faf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 21:07:21.652971 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: WARNING keystonemiddleware.auth_token [None req-5b7691a6-2c22-4995-a977-a3b1adde2ec5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 21:07:21.653349 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: WARNING keystonemiddleware.auth_token [None req-f35184bf-bd1c-4620-bb40-3520d4fb6faf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 21:07:21.658578 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564f517749c0 pid: 103348 (default app) Jun 27 21:07:21.659065 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: WARNING keystonemiddleware.auth_token [None req-5b7691a6-2c22-4995-a977-a3b1adde2ec5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 21:07:21.660715 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-f35184bf-bd1c-4620-bb40-3520d4fb6faf None None] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:07:21.661935 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-f35184bf-bd1c-4620-bb40-3520d4fb6faf None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001849 Jun 27 21:07:21.662343 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Mon Jun 27 21:07:21 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:07:21.664772 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564f517749c0 pid: 103349 (default app) Jun 27 21:08:37.977339 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-f35184bf-bd1c-4620-bb40-3520d4fb6faf None None] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:08:37.978379 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-f35184bf-bd1c-4620-bb40-3520d4fb6faf None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jun 27 21:08:37.978778 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 2/2] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 27 21:08:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:08:37.991398 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_api:SELECT=3 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:08:37.992254 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_cell0:SELECT=3 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:08:37.993027 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_cell1:SELECT=3 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:08:37.993741 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:08:38.438022 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-66624624-ea2b-4b46-b6fc-e760c372bba2 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:08:38.469285 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-66624624-ea2b-4b46-b6fc-e760c372bba2 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.483327 Jun 27 21:08:38.470022 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Jun 27 21:08:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:08:40.574665 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-f35184bf-bd1c-4620-bb40-3520d4fb6faf None None] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:08:40.575666 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-f35184bf-bd1c-4620-bb40-3520d4fb6faf None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 27 21:08:40.576032 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 3/4] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 27 21:08:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:08:40.646899 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-f8bf4b5b-5bb9-45cb-9e1b-fca6e33f6627 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "name": "cirros256", "id": "c1", "disk": 1}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:08:40.665619 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 21:08:40.665619 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: warnings.warn(msg) Jun 27 21:08:40.696299 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-f8bf4b5b-5bb9-45cb-9e1b-fca6e33f6627 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.114043 Jun 27 21:08:40.696862 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 2/5] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 27 21:08:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:08:40.711480 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_api:SELECT=3 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:08:40.712395 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_cell0:SELECT=3 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:08:40.713288 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_cell1:SELECT=3 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:08:40.714107 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:08:40.923416 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-0fae911e-2c97-49ce-acad-da1c31f14cb4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:08:40.926047 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 21:08:40.926047 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: warnings.warn(msg) Jun 27 21:08:40.989387 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-0fae911e-2c97-49ce-acad-da1c31f14cb4 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284234 Jun 27 21:08:40.990129 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 4/6] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Jun 27 21:08:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:08:43.101395 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-f8bf4b5b-5bb9-45cb-9e1b-fca6e33f6627 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:08:43.103022 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-f8bf4b5b-5bb9-45cb-9e1b-fca6e33f6627 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002170 Jun 27 21:08:43.103574 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 3/7] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 27 21:08:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:08:43.231008 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-b8268fa5-46a7-426c-a9b6-d227026692c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 5, "ram": 512}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:08:43.248548 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 21:08:43.248548 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: warnings.warn(msg) Jun 27 21:08:43.269065 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-b8268fa5-46a7-426c-a9b6-d227026692c2 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.159232 Jun 27 21:08:43.269628 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 5/8] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 27 21:08:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:08:43.282153 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-8548de66-73ea-48df-bbd3-a6e1b11396ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:08:43.283356 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 21:08:43.283356 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: warnings.warn(msg) Jun 27 21:08:43.317792 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-8548de66-73ea-48df-bbd3-a6e1b11396ca admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039552 Jun 27 21:08:43.318537 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 4/9] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Jun 27 21:08:43 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:08:45.405616 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-b8268fa5-46a7-426c-a9b6-d227026692c2 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:08:45.407240 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-b8268fa5-46a7-426c-a9b6-d227026692c2 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002130 Jun 27 21:08:45.407642 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 6/10] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 27 21:08:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:08:45.472044 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-44833818-124f-404e-b3b8-e25462e5bc85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "name": "ds1G", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "vcpus": 1, "ram": 1024}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:08:45.493557 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-44833818-124f-404e-b3b8-e25462e5bc85 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079615 Jun 27 21:08:45.494516 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 5/11] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 27 21:08:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:08:45.506697 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-92465ad2-f961-4130-befb-c702f60dc4a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:08:45.532968 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-92465ad2-f961-4130-befb-c702f60dc4a0 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030028 Jun 27 21:08:45.544956 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 7/12] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Jun 27 21:08:45 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:08:47.674123 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-44833818-124f-404e-b3b8-e25462e5bc85 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:08:47.676205 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-44833818-124f-404e-b3b8-e25462e5bc85 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003159 Jun 27 21:08:47.676737 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 6/13] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 27 21:08:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:08:47.737840 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-0e394652-e6cc-4802-8bd0-c0ebf87f5fd1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 2048}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:08:47.755751 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-0e394652-e6cc-4802-8bd0-c0ebf87f5fd1 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072935 Jun 27 21:08:47.756348 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 8/14] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 27 21:08:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:08:47.768557 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-56f08261-8056-4771-8b6e-1346489cda63 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:08:47.791164 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-56f08261-8056-4771-8b6e-1346489cda63 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026429 Jun 27 21:08:47.791901 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 7/15] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Jun 27 21:08:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:08:49.886755 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-0e394652-e6cc-4802-8bd0-c0ebf87f5fd1 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:08:49.887762 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-0e394652-e6cc-4802-8bd0-c0ebf87f5fd1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 27 21:08:49.888153 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 9/16] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 27 21:08:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:08:49.948684 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-682ad396-cabf-4299-9843-73f7b25c77dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "vcpus": 4}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:08:49.967679 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-682ad396-cabf-4299-9843-73f7b25c77dd admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073590 Jun 27 21:08:49.968303 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 8/17] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 27 21:08:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:08:49.981283 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-d2428f65-fbc8-46b8-bd89-bedd88779ed7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:08:50.006174 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-d2428f65-fbc8-46b8-bd89-bedd88779ed7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029006 Jun 27 21:08:50.006742 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 10/18] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Jun 27 21:08:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:08:52.135783 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-682ad396-cabf-4299-9843-73f7b25c77dd admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:08:52.136800 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-682ad396-cabf-4299-9843-73f7b25c77dd admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 27 21:08:52.137437 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 9/19] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 27 21:08:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:08:52.202245 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-2b8f9f5a-4fd6-4fa8-bee2-a3904b472abc admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:08:52.230644 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-2b8f9f5a-4fd6-4fa8-bee2-a3904b472abc admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086990 Jun 27 21:08:52.231329 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 11/20] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Jun 27 21:08:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:08:54.390029 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-682ad396-cabf-4299-9843-73f7b25c77dd admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:08:54.391084 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-682ad396-cabf-4299-9843-73f7b25c77dd admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001875 Jun 27 21:08:54.391481 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 10/21] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 27 21:08:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:08:54.464637 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-6c021888-39de-48a7-ab81-c9360c11bc34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.tiny", "id": "1", "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:08:54.485785 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-6c021888-39de-48a7-ab81-c9360c11bc34 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.087500 Jun 27 21:08:54.486368 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 12/22] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 27 21:08:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:08:54.500072 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-eb9b0c4c-f5cc-437f-86c8-f7fa7dd676c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:08:54.527355 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-eb9b0c4c-f5cc-437f-86c8-f7fa7dd676c4 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031340 Jun 27 21:08:54.528017 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 11/23] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Jun 27 21:08:54 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:08:56.767321 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-6c021888-39de-48a7-ab81-c9360c11bc34 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:08:56.768373 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-6c021888-39de-48a7-ab81-c9360c11bc34 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001633 Jun 27 21:08:56.768789 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 27 21:08:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:08:56.846197 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-30ba4fb0-3259-4cf1-88d8-e9b870147295 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 1, "swap": 0, "name": "m1.small", "disk": 20, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:08:56.868773 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-30ba4fb0-3259-4cf1-88d8-e9b870147295 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.092077 Jun 27 21:08:56.869399 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 12/25] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 27 21:08:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 21:08:56.882534 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-45de7723-355c-41db-9e29-43ac7e51c18d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:08:56.916045 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-45de7723-355c-41db-9e29-43ac7e51c18d admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037472 Jun 27 21:08:56.916669 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 14/26] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Jun 27 21:08:56 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:08:59.264057 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-30ba4fb0-3259-4cf1-88d8-e9b870147295 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:08:59.265558 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-30ba4fb0-3259-4cf1-88d8-e9b870147295 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002031 Jun 27 21:08:59.266137 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 27 21:08:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:08:59.344001 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-8af67201-eb92-4f5f-8a64-61e9d16fc306 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "vcpus": 2, "disk": 40, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:08:59.364865 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-8af67201-eb92-4f5f-8a64-61e9d16fc306 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.090213 Jun 27 21:08:59.366017 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 15/28] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 27 21:08:59 2022] POST /compute/v2.1/flavors => generated 406 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:08:59.378818 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-346a657b-b9c9-4c93-b573-82b29cce7c8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:08:59.405759 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-346a657b-b9c9-4c93-b573-82b29cce7c8b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031035 Jun 27 21:08:59.406375 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 14/29] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Jun 27 21:08:59 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:09:01.616512 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-8af67201-eb92-4f5f-8a64-61e9d16fc306 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:01.617571 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-8af67201-eb92-4f5f-8a64-61e9d16fc306 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Jun 27 21:09:01.617972 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 16/30] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 27 21:09:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:01.680216 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-60c50e81-f69a-45a8-b453-41c66966afac admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "name": "m1.large", "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 80, "id": "4"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:01.699339 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-60c50e81-f69a-45a8-b453-41c66966afac admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075200 Jun 27 21:09:01.699881 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 15/31] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 27 21:09:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:09:01.712020 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-81f2d6e9-b917-42c4-84af-2021271676f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:01.736738 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-81f2d6e9-b917-42c4-84af-2021271676f0 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028687 Jun 27 21:09:01.737656 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 17/32] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Jun 27 21:09:01 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:09:03.884783 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-60c50e81-f69a-45a8-b453-41c66966afac admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:03.886578 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-60c50e81-f69a-45a8-b453-41c66966afac admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002234 Jun 27 21:09:03.886994 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 16/33] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 27 21:09:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:03.951972 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-92450911-a43e-43c2-9821-fca01438184f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "vcpus": 8, "swap": 0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "ram": 16384, "rxtx_factor": 1.0}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:03.972832 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-92450911-a43e-43c2-9821-fca01438184f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.079694 Jun 27 21:09:03.980612 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 18/34] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 27 21:09:03 2022] POST /compute/v2.1/flavors => generated 408 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:09:03.986009 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-4c2f65c5-97b5-4863-bf5e-b11c5e084cba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:04.010007 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-4c2f65c5-97b5-4863-bf5e-b11c5e084cba admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027988 Jun 27 21:09:04.010590 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 17/35] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Jun 27 21:09:03 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:09:27.856820 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-92450911-a43e-43c2-9821-fca01438184f admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:27.857901 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-92450911-a43e-43c2-9821-fca01438184f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Jun 27 21:09:27.858298 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 19/36] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 27 21:09:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:27.869366 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:09:27.940135 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-fc4230bc-5b9f-4c5b-8042-a40ce14112d2 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:27.958486 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-fc4230bc-5b9f-4c5b-8042-a40ce14112d2 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.093723 Jun 27 21:09:27.959051 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Jun 27 21:09:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:09:28.911790 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-92450911-a43e-43c2-9821-fca01438184f admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:28.912858 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-92450911-a43e-43c2-9821-fca01438184f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Jun 27 21:09:28.913351 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 20/38] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 27 21:09:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:29.105690 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-11fc1793-1d98-43ee-905c-480fe6fe1400 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:29.111444 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.wsgi [None req-11fc1793-1d98-43ee-905c-480fe6fe1400 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 27 21:09:29.114853 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-11fc1793-1d98-43ee-905c-480fe6fe1400 admin admin] Request method failure captured: Jun 27 21:09:29.114853 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 27 21:09:29.114853 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: Accept: application/json Jun 27 21:09:29.114853 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: Accept-Encoding: gzip, deflate Jun 27 21:09:29.114853 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: Connection: keep-alive Jun 27 21:09:29.114853 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: Content-Length: 0 Jun 27 21:09:29.114853 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: Host: 10.222.0.13 Jun 27 21:09:29.114853 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: Openstack-Api-Version: compute 2.90 Jun 27 21:09:29.114853 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: Openstack-System-Scope: None Jun 27 21:09:29.114853 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: User-Agent: python-novaclient Jun 27 21:09:29.114853 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Auth-Token: gAAAAABiuhyIIa6Smwnd_P81BM73kQHXKIQMXoZICWQMHX2ZOHfeP1at_GciWg5Re59YLPiAtXieHhDpl8nigqyusIFKZal6j462t35KtGWjeyeU_NDRCMrFul2NccH59GF8zefjPDu9tOgBCvbOXwol2WFFu-6d2kJUL-snjI9jPoO71CVPg8w Jun 27 21:09:29.114853 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Domain-Id: None Jun 27 21:09:29.114853 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Domain-Name: None Jun 27 21:09:29.114853 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Identity-Status: Confirmed Jun 27 21:09:29.114853 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Is-Admin-Project: True Jun 27 21:09:29.114853 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 21:09:29.114853 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Project-Domain-Id: default Jun 27 21:09:29.114853 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Project-Domain-Name: Default Jun 27 21:09:29.114853 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Project-Id: b6e5cf8b46f34e30a9b900f3cd1507c0 Jun 27 21:09:29.114853 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Project-Name: admin Jun 27 21:09:29.114853 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Role: admin,reader,member Jun 27 21:09:29.114853 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Roles: admin,reader,member Jun 27 21:09:29.116428 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b6e5cf8b46f34e30a9b900f3cd1507c0", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6e5cf8b46f34e30a9b900f3cd1507c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b6e5cf8b46f34e30a9b900f3cd1507c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6e5cf8b46f34e30a9b900f3cd1507c0"}]}] Jun 27 21:09:29.116428 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Tenant: admin Jun 27 21:09:29.116428 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Tenant-Id: b6e5cf8b46f34e30a9b900f3cd1507c0 Jun 27 21:09:29.116428 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Tenant-Name: admin Jun 27 21:09:29.116428 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-User: admin Jun 27 21:09:29.116428 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-User-Domain-Id: default Jun 27 21:09:29.116428 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-User-Domain-Name: Default Jun 27 21:09:29.116428 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-User-Id: a9e7736617b74291b419604a9ff9d7e1 Jun 27 21:09:29.116428 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-User-Name: admin Jun 27 21:09:29.116428 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: method: > Jun 27 21:09:29.116428 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: exception: Flavor 42 could not be found. Jun 27 21:09:29.116428 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: action_args: {'id': '42'} Jun 27 21:09:29.116428 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:09:29.116428 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:29.117505 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 21:09:29.117505 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 21:09:29.117505 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 21:09:29.117505 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 21:09:29.117505 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 21:09:29.117505 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 21:09:29.117505 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 21:09:29.117505 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 21:09:29.117505 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 21:09:29.117505 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:29.117505 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 21:09:29.117505 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 21:09:29.117505 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 27 21:09:29.117505 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 27 21:09:29.117505 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:29.117505 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 27 21:09:29.117505 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:29.117505 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:29.117505 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:29.118730 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:09:29.118730 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:09:29.118730 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:09:29.118730 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:29.118730 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 21:09:29.118730 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:09:29.118730 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 27 21:09:29.118730 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 27 21:09:29.118730 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:29.118730 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 27 21:09:29.118730 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:29.118730 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:29.118730 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:29.118730 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:09:29.118730 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:09:29.118730 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 27 21:09:29.118730 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 27 21:09:29.118730 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-11fc1793-1d98-43ee-905c-480fe6fe1400 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:09:29.119866 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-11fc1793-1d98-43ee-905c-480fe6fe1400 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.067052 Jun 27 21:09:29.119866 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 19/39] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Jun 27 21:09:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 21:09:29.126572 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-b413dcc7-8149-4fb9-8328-97c9cd66c347 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:29.129771 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:09:29.149426 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-b413dcc7-8149-4fb9-8328-97c9cd66c347 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026399 Jun 27 21:09:29.150000 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 21/40] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jun 27 21:09:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:09:29.159805 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-4def678a-ec82-4ed8-8e2a-fcec581a3541 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:29.181145 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-4def678a-ec82-4ed8-8e2a-fcec581a3541 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024759 Jun 27 21:09:29.181754 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jun 27 21:09:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:09:29.193998 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-bc90c5c3-1fca-42ff-ba73-59598c3001f3 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:29.200175 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.wsgi [None req-bc90c5c3-1fca-42ff-ba73-59598c3001f3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 27 21:09:29.203491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-bc90c5c3-1fca-42ff-ba73-59598c3001f3 admin admin] Request method failure captured: Jun 27 21:09:29.203491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 27 21:09:29.203491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: Accept: application/json Jun 27 21:09:29.203491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: Accept-Encoding: gzip, deflate Jun 27 21:09:29.203491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: Connection: keep-alive Jun 27 21:09:29.203491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: Content-Length: 0 Jun 27 21:09:29.203491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: Host: 10.222.0.13 Jun 27 21:09:29.203491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: Openstack-Api-Version: compute 2.90 Jun 27 21:09:29.203491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: Openstack-System-Scope: None Jun 27 21:09:29.203491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: User-Agent: python-novaclient Jun 27 21:09:29.203491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Auth-Token: gAAAAABiuhyIIa6Smwnd_P81BM73kQHXKIQMXoZICWQMHX2ZOHfeP1at_GciWg5Re59YLPiAtXieHhDpl8nigqyusIFKZal6j462t35KtGWjeyeU_NDRCMrFul2NccH59GF8zefjPDu9tOgBCvbOXwol2WFFu-6d2kJUL-snjI9jPoO71CVPg8w Jun 27 21:09:29.203491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Domain-Id: None Jun 27 21:09:29.203491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Domain-Name: None Jun 27 21:09:29.203491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Identity-Status: Confirmed Jun 27 21:09:29.203491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Is-Admin-Project: True Jun 27 21:09:29.203491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 21:09:29.203491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Project-Domain-Id: default Jun 27 21:09:29.203491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Project-Domain-Name: Default Jun 27 21:09:29.203491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Project-Id: b6e5cf8b46f34e30a9b900f3cd1507c0 Jun 27 21:09:29.203491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Project-Name: admin Jun 27 21:09:29.203491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Role: admin,reader,member Jun 27 21:09:29.203491 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Roles: admin,reader,member Jun 27 21:09:29.205073 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b6e5cf8b46f34e30a9b900f3cd1507c0", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6e5cf8b46f34e30a9b900f3cd1507c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b6e5cf8b46f34e30a9b900f3cd1507c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6e5cf8b46f34e30a9b900f3cd1507c0"}]}] Jun 27 21:09:29.205073 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Tenant: admin Jun 27 21:09:29.205073 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Tenant-Id: b6e5cf8b46f34e30a9b900f3cd1507c0 Jun 27 21:09:29.205073 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Tenant-Name: admin Jun 27 21:09:29.205073 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-User: admin Jun 27 21:09:29.205073 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-User-Domain-Id: default Jun 27 21:09:29.205073 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-User-Domain-Name: Default Jun 27 21:09:29.205073 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-User-Id: a9e7736617b74291b419604a9ff9d7e1 Jun 27 21:09:29.205073 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-User-Name: admin Jun 27 21:09:29.205073 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: method: > Jun 27 21:09:29.205073 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: exception: Flavor 42 could not be found. Jun 27 21:09:29.205073 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: action_args: {'id': '42'} Jun 27 21:09:29.205073 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:09:29.205073 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:29.206058 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 21:09:29.206058 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 21:09:29.206058 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 21:09:29.206058 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 21:09:29.206058 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 21:09:29.206058 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 21:09:29.206058 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 21:09:29.206058 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 21:09:29.206058 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 21:09:29.206058 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:29.206058 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 21:09:29.206058 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 21:09:29.206058 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 27 21:09:29.206058 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 27 21:09:29.206058 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:29.206058 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 27 21:09:29.206058 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:29.206058 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:29.206058 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:29.207262 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:09:29.207262 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:09:29.207262 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:09:29.207262 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:29.207262 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 21:09:29.207262 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:09:29.207262 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 27 21:09:29.207262 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 27 21:09:29.207262 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:29.207262 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 27 21:09:29.207262 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:29.207262 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:29.207262 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:29.207262 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:09:29.207262 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:09:29.207262 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 27 21:09:29.207262 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 27 21:09:29.207262 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-bc90c5c3-1fca-42ff-ba73-59598c3001f3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:09:29.208768 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-bc90c5c3-1fca-42ff-ba73-59598c3001f3 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016709 Jun 27 21:09:29.208768 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 22/42] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Jun 27 21:09:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 21:09:30.040753 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-4def678a-ec82-4ed8-8e2a-fcec581a3541 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:30.041794 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-4def678a-ec82-4ed8-8e2a-fcec581a3541 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jun 27 21:09:30.042172 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 21/43] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 27 21:09:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:30.232341 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-9839b389-bf97-48e1-823a-b9f23683f3cc admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:30.238626 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.wsgi [None req-9839b389-bf97-48e1-823a-b9f23683f3cc admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 27 21:09:30.240323 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-9839b389-bf97-48e1-823a-b9f23683f3cc admin admin] Request method failure captured: Jun 27 21:09:30.240323 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 27 21:09:30.240323 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: Accept: application/json Jun 27 21:09:30.240323 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: Accept-Encoding: gzip, deflate Jun 27 21:09:30.240323 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: Connection: keep-alive Jun 27 21:09:30.240323 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: Content-Length: 0 Jun 27 21:09:30.240323 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: Host: 10.222.0.13 Jun 27 21:09:30.240323 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: Openstack-Api-Version: compute 2.90 Jun 27 21:09:30.240323 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: Openstack-System-Scope: None Jun 27 21:09:30.240323 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: User-Agent: python-novaclient Jun 27 21:09:30.240323 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Auth-Token: gAAAAABiuhyKaHaqK3TGY-kBOh1ehW_LcqPte9TiWx7fuyFl2Ew5604J_hcuAhnEAbdJ38FtHQ6eSDKPYnAJIYiHuD5gXDalMKkM9AcuFVjF-__Gag0v7Rg-NXEMVgtjhGtNw2ai0mjTaLhnV1JNeU3p0HhiRZ78Jwmt-kuxtbEhhMLTauf-U2A Jun 27 21:09:30.240323 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Domain-Id: None Jun 27 21:09:30.240323 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Domain-Name: None Jun 27 21:09:30.240323 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Identity-Status: Confirmed Jun 27 21:09:30.240323 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Is-Admin-Project: True Jun 27 21:09:30.240323 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 21:09:30.240323 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Project-Domain-Id: default Jun 27 21:09:30.240323 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Project-Domain-Name: Default Jun 27 21:09:30.240323 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Project-Id: b6e5cf8b46f34e30a9b900f3cd1507c0 Jun 27 21:09:30.240323 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Project-Name: admin Jun 27 21:09:30.240323 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Role: admin,reader,member Jun 27 21:09:30.240323 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Roles: admin,reader,member Jun 27 21:09:30.241698 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b6e5cf8b46f34e30a9b900f3cd1507c0", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6e5cf8b46f34e30a9b900f3cd1507c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b6e5cf8b46f34e30a9b900f3cd1507c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6e5cf8b46f34e30a9b900f3cd1507c0"}]}] Jun 27 21:09:30.241698 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Tenant: admin Jun 27 21:09:30.241698 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Tenant-Id: b6e5cf8b46f34e30a9b900f3cd1507c0 Jun 27 21:09:30.241698 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Tenant-Name: admin Jun 27 21:09:30.241698 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-User: admin Jun 27 21:09:30.241698 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-User-Domain-Id: default Jun 27 21:09:30.241698 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-User-Domain-Name: Default Jun 27 21:09:30.241698 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-User-Id: a9e7736617b74291b419604a9ff9d7e1 Jun 27 21:09:30.241698 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-User-Name: admin Jun 27 21:09:30.241698 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: method: > Jun 27 21:09:30.241698 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: exception: Flavor 84 could not be found. Jun 27 21:09:30.241698 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: action_args: {'id': '84'} Jun 27 21:09:30.241698 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:09:30.241698 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:30.242580 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 21:09:30.242580 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 21:09:30.242580 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 21:09:30.242580 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 21:09:30.242580 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 21:09:30.242580 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 21:09:30.242580 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 21:09:30.242580 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 21:09:30.242580 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 21:09:30.242580 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:30.242580 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 21:09:30.242580 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 21:09:30.242580 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 27 21:09:30.242580 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 27 21:09:30.242580 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:30.242580 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 27 21:09:30.242580 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:30.242580 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:30.242580 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:30.243742 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:09:30.243742 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:09:30.243742 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:09:30.243742 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:30.243742 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 21:09:30.243742 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:09:30.243742 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 27 21:09:30.243742 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 27 21:09:30.243742 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:30.243742 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 27 21:09:30.243742 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:30.243742 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:30.243742 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:30.243742 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:09:30.243742 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:09:30.243742 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 27 21:09:30.243742 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 27 21:09:30.243742 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-9839b389-bf97-48e1-823a-b9f23683f3cc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:09:30.244774 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-9839b389-bf97-48e1-823a-b9f23683f3cc admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.064461 Jun 27 21:09:30.244774 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 23/44] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Jun 27 21:09:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 21:09:30.251671 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-b80a1028-dd24-4fff-ab3d-c717cfd909ed admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:30.265671 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-b80a1028-dd24-4fff-ab3d-c717cfd909ed admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017580 Jun 27 21:09:30.266144 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 22/45] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jun 27 21:09:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:09:30.275901 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-31520610-8f35-423f-813d-e3b49e8a2615 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:30.290613 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-31520610-8f35-423f-813d-e3b49e8a2615 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018262 Jun 27 21:09:30.291114 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jun 27 21:09:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:09:30.300852 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-501b2aed-51fc-4286-b1b7-fa5f9b97b17e admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:30.306999 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.wsgi [None req-501b2aed-51fc-4286-b1b7-fa5f9b97b17e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 27 21:09:30.308539 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-501b2aed-51fc-4286-b1b7-fa5f9b97b17e admin admin] Request method failure captured: Jun 27 21:09:30.308539 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 27 21:09:30.308539 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: Accept: application/json Jun 27 21:09:30.308539 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: Accept-Encoding: gzip, deflate Jun 27 21:09:30.308539 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: Connection: keep-alive Jun 27 21:09:30.308539 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: Content-Length: 0 Jun 27 21:09:30.308539 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: Host: 10.222.0.13 Jun 27 21:09:30.308539 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: Openstack-Api-Version: compute 2.90 Jun 27 21:09:30.308539 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: Openstack-System-Scope: None Jun 27 21:09:30.308539 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: User-Agent: python-novaclient Jun 27 21:09:30.308539 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Auth-Token: gAAAAABiuhyKaHaqK3TGY-kBOh1ehW_LcqPte9TiWx7fuyFl2Ew5604J_hcuAhnEAbdJ38FtHQ6eSDKPYnAJIYiHuD5gXDalMKkM9AcuFVjF-__Gag0v7Rg-NXEMVgtjhGtNw2ai0mjTaLhnV1JNeU3p0HhiRZ78Jwmt-kuxtbEhhMLTauf-U2A Jun 27 21:09:30.308539 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Domain-Id: None Jun 27 21:09:30.308539 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Domain-Name: None Jun 27 21:09:30.308539 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Identity-Status: Confirmed Jun 27 21:09:30.308539 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Is-Admin-Project: True Jun 27 21:09:30.308539 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 21:09:30.308539 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Project-Domain-Id: default Jun 27 21:09:30.308539 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Project-Domain-Name: Default Jun 27 21:09:30.308539 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Project-Id: b6e5cf8b46f34e30a9b900f3cd1507c0 Jun 27 21:09:30.308539 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Project-Name: admin Jun 27 21:09:30.308539 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Role: admin,reader,member Jun 27 21:09:30.308539 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Roles: admin,reader,member Jun 27 21:09:30.310026 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b6e5cf8b46f34e30a9b900f3cd1507c0", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6e5cf8b46f34e30a9b900f3cd1507c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b6e5cf8b46f34e30a9b900f3cd1507c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6e5cf8b46f34e30a9b900f3cd1507c0"}]}] Jun 27 21:09:30.310026 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Tenant: admin Jun 27 21:09:30.310026 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Tenant-Id: b6e5cf8b46f34e30a9b900f3cd1507c0 Jun 27 21:09:30.310026 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Tenant-Name: admin Jun 27 21:09:30.310026 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-User: admin Jun 27 21:09:30.310026 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-User-Domain-Id: default Jun 27 21:09:30.310026 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-User-Domain-Name: Default Jun 27 21:09:30.310026 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-User-Id: a9e7736617b74291b419604a9ff9d7e1 Jun 27 21:09:30.310026 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-User-Name: admin Jun 27 21:09:30.310026 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: method: > Jun 27 21:09:30.310026 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: exception: Flavor 84 could not be found. Jun 27 21:09:30.310026 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: action_args: {'id': '84'} Jun 27 21:09:30.310026 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:09:30.310026 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:30.311077 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 21:09:30.311077 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 21:09:30.311077 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 21:09:30.311077 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 21:09:30.311077 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 21:09:30.311077 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 21:09:30.311077 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 21:09:30.311077 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 21:09:30.311077 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 21:09:30.311077 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:30.311077 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 21:09:30.311077 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 21:09:30.311077 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 27 21:09:30.311077 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 27 21:09:30.311077 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:30.311077 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 27 21:09:30.311077 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:30.311077 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:30.311077 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:30.312434 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:09:30.312434 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:09:30.312434 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:09:30.312434 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:30.312434 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 21:09:30.312434 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:09:30.312434 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 27 21:09:30.312434 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 27 21:09:30.312434 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:30.312434 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 27 21:09:30.312434 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:30.312434 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:30.312434 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:30.312434 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:09:30.312434 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:09:30.312434 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 27 21:09:30.312434 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 27 21:09:30.312434 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-501b2aed-51fc-4286-b1b7-fa5f9b97b17e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:09:30.313611 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-501b2aed-51fc-4286-b1b7-fa5f9b97b17e admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012776 Jun 27 21:09:30.313611 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 23/47] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Jun 27 21:09:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 21:09:31.138338 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-31520610-8f35-423f-813d-e3b49e8a2615 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:31.139349 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-31520610-8f35-423f-813d-e3b49e8a2615 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 27 21:09:31.139780 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 25/48] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 27 21:09:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:31.334019 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-0b6a6349-b725-43bc-8b43-6bdbdb9a7085 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:31.340357 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.wsgi [None req-0b6a6349-b725-43bc-8b43-6bdbdb9a7085 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 27 21:09:31.341920 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-0b6a6349-b725-43bc-8b43-6bdbdb9a7085 admin admin] Request method failure captured: Jun 27 21:09:31.341920 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 27 21:09:31.341920 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: Accept: application/json Jun 27 21:09:31.341920 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: Accept-Encoding: gzip, deflate Jun 27 21:09:31.341920 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: Connection: keep-alive Jun 27 21:09:31.341920 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: Content-Length: 0 Jun 27 21:09:31.341920 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: Host: 10.222.0.13 Jun 27 21:09:31.341920 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: Openstack-Api-Version: compute 2.90 Jun 27 21:09:31.341920 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: Openstack-System-Scope: None Jun 27 21:09:31.341920 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: User-Agent: python-novaclient Jun 27 21:09:31.341920 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Auth-Token: gAAAAABiuhyLFc13N2WJs13TZf6EDL6O6QdedSE2E76wx7zrB1lKYlS4jvSrKSxoFLOL6iddPEcxmxng_ayhpHZTnHfAvs1kuwWm9vRc5IH0xfBV6HxKC8dcv83Mfbyr7GOizhmD8o-Qc0ZzOW7L8p0kS4AEzAS_qJflvfGt6m3q_n-Cb9bQQSU Jun 27 21:09:31.341920 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Domain-Id: None Jun 27 21:09:31.341920 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Domain-Name: None Jun 27 21:09:31.341920 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Identity-Status: Confirmed Jun 27 21:09:31.341920 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Is-Admin-Project: True Jun 27 21:09:31.341920 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 21:09:31.341920 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Project-Domain-Id: default Jun 27 21:09:31.341920 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Project-Domain-Name: Default Jun 27 21:09:31.341920 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Project-Id: b6e5cf8b46f34e30a9b900f3cd1507c0 Jun 27 21:09:31.341920 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Project-Name: admin Jun 27 21:09:31.341920 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Role: admin,reader,member Jun 27 21:09:31.341920 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Roles: admin,reader,member Jun 27 21:09:31.343383 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b6e5cf8b46f34e30a9b900f3cd1507c0", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6e5cf8b46f34e30a9b900f3cd1507c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b6e5cf8b46f34e30a9b900f3cd1507c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6e5cf8b46f34e30a9b900f3cd1507c0"}]}] Jun 27 21:09:31.343383 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Tenant: admin Jun 27 21:09:31.343383 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Tenant-Id: b6e5cf8b46f34e30a9b900f3cd1507c0 Jun 27 21:09:31.343383 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-Tenant-Name: admin Jun 27 21:09:31.343383 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-User: admin Jun 27 21:09:31.343383 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-User-Domain-Id: default Jun 27 21:09:31.343383 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-User-Domain-Name: Default Jun 27 21:09:31.343383 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-User-Id: a9e7736617b74291b419604a9ff9d7e1 Jun 27 21:09:31.343383 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: X-User-Name: admin Jun 27 21:09:31.343383 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: method: > Jun 27 21:09:31.343383 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: exception: Flavor 451 could not be found. Jun 27 21:09:31.343383 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: action_args: {'id': '451'} Jun 27 21:09:31.343383 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:09:31.343383 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:31.344416 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 21:09:31.344416 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 21:09:31.344416 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 21:09:31.344416 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 21:09:31.344416 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 21:09:31.344416 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 21:09:31.344416 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 21:09:31.344416 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 21:09:31.344416 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 21:09:31.344416 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:31.344416 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 21:09:31.344416 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 21:09:31.344416 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 27 21:09:31.344416 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 27 21:09:31.344416 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:31.344416 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 27 21:09:31.344416 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:31.344416 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:31.344416 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:31.346224 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:09:31.346224 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:09:31.346224 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:09:31.346224 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:31.346224 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 21:09:31.346224 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:09:31.346224 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 27 21:09:31.346224 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 27 21:09:31.346224 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:31.346224 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 27 21:09:31.346224 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:31.346224 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:31.346224 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:31.346224 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:09:31.346224 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:09:31.346224 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 27 21:09:31.346224 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: ERROR nova.api.openstack.wsgi Jun 27 21:09:31.346224 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-0b6a6349-b725-43bc-8b43-6bdbdb9a7085 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:09:31.347455 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-0b6a6349-b725-43bc-8b43-6bdbdb9a7085 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.065615 Jun 27 21:09:31.347455 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 24/49] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jun 27 21:09:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 21:09:31.354215 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-e55b8075-06cb-4399-95ac-38583c8afd94 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:31.368682 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-e55b8075-06cb-4399-95ac-38583c8afd94 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017994 Jun 27 21:09:31.369235 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 26/50] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jun 27 21:09:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:09:31.379380 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-0a4042cb-fbfa-4fcd-8116-97963f1d4139 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:31.395224 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-0a4042cb-fbfa-4fcd-8116-97963f1d4139 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019426 Jun 27 21:09:31.395794 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 25/51] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jun 27 21:09:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:09:31.405711 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-a7f81e91-58a2-4cb6-9c6c-6ef303e7b3ce admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:31.411730 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.wsgi [None req-a7f81e91-58a2-4cb6-9c6c-6ef303e7b3ce admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 27 21:09:31.413469 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-a7f81e91-58a2-4cb6-9c6c-6ef303e7b3ce admin admin] Request method failure captured: Jun 27 21:09:31.413469 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 27 21:09:31.413469 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: Accept: application/json Jun 27 21:09:31.413469 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: Accept-Encoding: gzip, deflate Jun 27 21:09:31.413469 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: Connection: keep-alive Jun 27 21:09:31.413469 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: Content-Length: 0 Jun 27 21:09:31.413469 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: Host: 10.222.0.13 Jun 27 21:09:31.413469 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: Openstack-Api-Version: compute 2.90 Jun 27 21:09:31.413469 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: Openstack-System-Scope: None Jun 27 21:09:31.413469 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: User-Agent: python-novaclient Jun 27 21:09:31.413469 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Auth-Token: gAAAAABiuhyLFc13N2WJs13TZf6EDL6O6QdedSE2E76wx7zrB1lKYlS4jvSrKSxoFLOL6iddPEcxmxng_ayhpHZTnHfAvs1kuwWm9vRc5IH0xfBV6HxKC8dcv83Mfbyr7GOizhmD8o-Qc0ZzOW7L8p0kS4AEzAS_qJflvfGt6m3q_n-Cb9bQQSU Jun 27 21:09:31.413469 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Domain-Id: None Jun 27 21:09:31.413469 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Domain-Name: None Jun 27 21:09:31.413469 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Identity-Status: Confirmed Jun 27 21:09:31.413469 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Is-Admin-Project: True Jun 27 21:09:31.413469 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 21:09:31.413469 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Project-Domain-Id: default Jun 27 21:09:31.413469 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Project-Domain-Name: Default Jun 27 21:09:31.413469 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Project-Id: b6e5cf8b46f34e30a9b900f3cd1507c0 Jun 27 21:09:31.413469 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Project-Name: admin Jun 27 21:09:31.413469 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Role: admin,reader,member Jun 27 21:09:31.413469 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Roles: admin,reader,member Jun 27 21:09:31.415070 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b6e5cf8b46f34e30a9b900f3cd1507c0", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6e5cf8b46f34e30a9b900f3cd1507c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b6e5cf8b46f34e30a9b900f3cd1507c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6e5cf8b46f34e30a9b900f3cd1507c0"}]}] Jun 27 21:09:31.415070 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Tenant: admin Jun 27 21:09:31.415070 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Tenant-Id: b6e5cf8b46f34e30a9b900f3cd1507c0 Jun 27 21:09:31.415070 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-Tenant-Name: admin Jun 27 21:09:31.415070 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-User: admin Jun 27 21:09:31.415070 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-User-Domain-Id: default Jun 27 21:09:31.415070 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-User-Domain-Name: Default Jun 27 21:09:31.415070 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-User-Id: a9e7736617b74291b419604a9ff9d7e1 Jun 27 21:09:31.415070 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: X-User-Name: admin Jun 27 21:09:31.415070 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: method: > Jun 27 21:09:31.415070 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: exception: Flavor 451 could not be found. Jun 27 21:09:31.415070 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: action_args: {'id': '451'} Jun 27 21:09:31.415070 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:09:31.415070 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:31.416124 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 21:09:31.416124 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 21:09:31.416124 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 21:09:31.416124 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 21:09:31.416124 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 21:09:31.416124 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 21:09:31.416124 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 21:09:31.416124 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 21:09:31.416124 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 21:09:31.416124 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:31.416124 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 21:09:31.416124 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 21:09:31.416124 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 27 21:09:31.416124 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 27 21:09:31.416124 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:31.416124 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 27 21:09:31.416124 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:31.416124 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:31.416124 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:31.417516 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:09:31.417516 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:09:31.417516 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:09:31.417516 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:31.417516 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 21:09:31.417516 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:09:31.417516 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 27 21:09:31.417516 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 27 21:09:31.417516 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:31.417516 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 27 21:09:31.417516 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:31.417516 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:31.417516 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:31.417516 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:09:31.417516 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:09:31.417516 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 27 21:09:31.417516 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: ERROR nova.api.openstack.wsgi Jun 27 21:09:31.417516 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-a7f81e91-58a2-4cb6-9c6c-6ef303e7b3ce admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:09:31.418759 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-a7f81e91-58a2-4cb6-9c6c-6ef303e7b3ce admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012719 Jun 27 21:09:31.418759 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 27/52] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jun 27 21:09:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 21:09:32.246911 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-0a4042cb-fbfa-4fcd-8116-97963f1d4139 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:32.247944 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-0a4042cb-fbfa-4fcd-8116-97963f1d4139 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jun 27 21:09:32.248328 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 27 21:09:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:32.443771 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-f30abeca-8de6-44f5-b49b-a6748f956391 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:32.463988 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-f30abeca-8de6-44f5-b49b-a6748f956391 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.076947 Jun 27 21:09:32.464544 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 28/54] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Jun 27 21:09:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:09:33.293612 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-0a4042cb-fbfa-4fcd-8116-97963f1d4139 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:33.294612 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-0a4042cb-fbfa-4fcd-8116-97963f1d4139 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 27 21:09:33.295035 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 27/55] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 27 21:09:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:33.483736 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-175ed055-c5a0-415f-bcc4-b57a12cf5180 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:33.503388 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-175ed055-c5a0-415f-bcc4-b57a12cf5180 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.072014 Jun 27 21:09:33.503929 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 29/56] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Jun 27 21:09:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:09:34.324428 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-0a4042cb-fbfa-4fcd-8116-97963f1d4139 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:34.325512 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-0a4042cb-fbfa-4fcd-8116-97963f1d4139 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jun 27 21:09:34.325898 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 28/57] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 27 21:09:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:34.517684 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-1a1059c4-3853-4b87-a98f-e9fe0b82ff5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:34.537250 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-1a1059c4-3853-4b87-a98f-e9fe0b82ff5f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.074741 Jun 27 21:09:34.537724 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 30/58] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Jun 27 21:09:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:09:35.373393 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-0a4042cb-fbfa-4fcd-8116-97963f1d4139 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:35.374556 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-0a4042cb-fbfa-4fcd-8116-97963f1d4139 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 27 21:09:35.374952 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 29/59] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 27 21:09:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:35.573576 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-d6d69300-2e34-4556-b8a6-64040dc63ab2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:35.593783 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-d6d69300-2e34-4556-b8a6-64040dc63ab2 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.079777 Jun 27 21:09:35.594313 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 31/60] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Jun 27 21:09:35 2022] POST /compute/v2.1/flavors => generated 409 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:09:36.438817 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-0a4042cb-fbfa-4fcd-8116-97963f1d4139 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:36.439817 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-0a4042cb-fbfa-4fcd-8116-97963f1d4139 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jun 27 21:09:36.440210 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 30/61] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 27 21:09:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:36.650516 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-8a4e97eb-d71a-447a-b2f9-9f747ce508d7 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:36.670210 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-8a4e97eb-d71a-447a-b2f9-9f747ce508d7 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.079452 Jun 27 21:09:36.670781 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 32/62] 10.222.0.13 () {60 vars in 1202 bytes} [Mon Jun 27 21:09:36 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:10:23.840181 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-0a4042cb-fbfa-4fcd-8116-97963f1d4139 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:10:23.841245 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-0a4042cb-fbfa-4fcd-8116-97963f1d4139 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 27 21:10:23.841641 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 27 21:10:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:10:23.852648 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:10:23.904619 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-2e783f0d-9ff0-4563-9764-aab5e13209d8 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:10:23.924467 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-2e783f0d-9ff0-4563-9764-aab5e13209d8 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076399 Jun 27 21:10:23.924992 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Jun 27 21:10:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:10:23.947840 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-d582d016-4302-4c23-afe5-dd23edeccc46 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:10:23.951357 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG dbcounter [-] [103349] Writing DB stats nova_api:SELECT=14 {{(pid=103349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:10:23.956714 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-d582d016-4302-4c23-afe5-dd23edeccc46 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012533 Jun 27 21:10:23.957294 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 32/65] 10.222.0.13 () {60 vars in 1282 bytes} [Mon Jun 27 21:10:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:10:23.969150 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-19f7017a-5254-4f4d-8732-96e4e4cfcdeb admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:10:23.978161 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-19f7017a-5254-4f4d-8732-96e4e4cfcdeb admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012712 Jun 27 21:10:23.978682 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 34/66] 10.222.0.13 () {60 vars in 1285 bytes} [Mon Jun 27 21:10:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:10:23.990693 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-7bb0ed35-3de7-41b5-87af-6f356ebc99e1 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:10:23.998596 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-7bb0ed35-3de7-41b5-87af-6f356ebc99e1 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012030 Jun 27 21:10:23.999113 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 33/67] 10.222.0.13 () {60 vars in 1285 bytes} [Mon Jun 27 21:10:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:10:24.010789 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-4020335e-a503-4a7d-ac54-32ba1e5abe59 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:10:24.018926 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-4020335e-a503-4a7d-ac54-32ba1e5abe59 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011782 Jun 27 21:10:24.019516 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 35/68] 10.222.0.13 () {60 vars in 1282 bytes} [Mon Jun 27 21:10:24 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:13:42.039535 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-7bb0ed35-3de7-41b5-87af-6f356ebc99e1 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:13:42.040601 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-7bb0ed35-3de7-41b5-87af-6f356ebc99e1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 27 21:13:42.041035 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 27 21:13:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:13:42.183517 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_api:SELECT=6 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:13:42.318771 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-e6693858-4bc2-45e2-9b43-a419fbf9be46 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:13:42.320510 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 21:13:42.320510 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: warnings.warn(msg) Jun 27 21:13:42.322338 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-e6693858-4bc2-45e2-9b43-a419fbf9be46 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:13:42.323012 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-e6693858-4bc2-45e2-9b43-a419fbf9be46 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:13:42.323898 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-e6693858-4bc2-45e2-9b43-a419fbf9be46 admin admin] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:13:42.324509 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-e6693858-4bc2-45e2-9b43-a419fbf9be46 admin admin] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:13:42.361894 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-e6693858-4bc2-45e2-9b43-a419fbf9be46 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.180424 Jun 27 21:13:42.362493 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 36/70] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jun 27 21:13:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:13:43.211453 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-7bb0ed35-3de7-41b5-87af-6f356ebc99e1 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:13:43.212466 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-7bb0ed35-3de7-41b5-87af-6f356ebc99e1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jun 27 21:13:43.212857 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 27 21:13:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:13:43.424758 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-5920e29d-f564-4ada-a74a-7933be2751f3 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:13:43.426033 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 21:13:43.426033 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: warnings.warn(msg) Jun 27 21:13:43.427343 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-5920e29d-f564-4ada-a74a-7933be2751f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:13:43.427793 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-5920e29d-f564-4ada-a74a-7933be2751f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:13:43.428611 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-5920e29d-f564-4ada-a74a-7933be2751f3 admin admin] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:13:43.429075 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-5920e29d-f564-4ada-a74a-7933be2751f3 admin admin] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:13:43.449814 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-5920e29d-f564-4ada-a74a-7933be2751f3 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.095741 Jun 27 21:13:43.450373 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 37/72] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jun 27 21:13:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 21:13:54.748419 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-7bb0ed35-3de7-41b5-87af-6f356ebc99e1 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:13:54.749454 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-7bb0ed35-3de7-41b5-87af-6f356ebc99e1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jun 27 21:13:54.749855 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 36/73] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 27 21:13:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:13:54.892352 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_cell0:SELECT=4 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:13:54.893101 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_cell1:SELECT=4 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:13:54.893741 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG dbcounter [-] [103348] Writing DB stats nova_api:SELECT=8 {{(pid=103348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:13:54.963012 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-e428bae1-961e-490c-bce6-151dc0913e6a admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:13:54.964207 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 21:13:54.964207 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: warnings.warn(msg) Jun 27 21:13:54.965599 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-e428bae1-961e-490c-bce6-151dc0913e6a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:13:54.966482 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-e428bae1-961e-490c-bce6-151dc0913e6a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:13:54.967265 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-e428bae1-961e-490c-bce6-151dc0913e6a admin admin] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:13:54.967687 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-e428bae1-961e-490c-bce6-151dc0913e6a admin admin] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:13:54.993919 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-e428bae1-961e-490c-bce6-151dc0913e6a admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.106102 Jun 27 21:13:54.994466 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 38/74] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jun 27 21:13:54 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:13:56.418987 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: DEBUG nova.api.openstack.wsgi [None req-7bb0ed35-3de7-41b5-87af-6f356ebc99e1 admin admin] Calling method '>' {{(pid=103349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:13:56.419996 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: INFO nova.api.openstack.requestlog [None req-7bb0ed35-3de7-41b5-87af-6f356ebc99e1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Jun 27 21:13:56.420405 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: [pid: 103349|app: 0|req: 37/75] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 27 21:13:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:13:56.619245 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG nova.api.openstack.wsgi [None req-4a96a20c-d960-4e1a-94bc-80c247f72217 admin admin] Calling method '>' {{(pid=103348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:13:56.620524 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 21:13:56.620524 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: warnings.warn(msg) Jun 27 21:13:56.621793 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-4a96a20c-d960-4e1a-94bc-80c247f72217 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:13:56.622228 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-4a96a20c-d960-4e1a-94bc-80c247f72217 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:13:56.623026 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-4a96a20c-d960-4e1a-94bc-80c247f72217 admin admin] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:13:56.623448 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: DEBUG oslo_concurrency.lockutils [None req-4a96a20c-d960-4e1a-94bc-80c247f72217 admin admin] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103348) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:13:56.645560 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: INFO nova.api.openstack.requestlog [None req-4a96a20c-d960-4e1a-94bc-80c247f72217 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084592 Jun 27 21:13:56.646137 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: [pid: 103348|app: 0|req: 39/76] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jun 27 21:13:56 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:14:52.864461 dv-cinder-847732-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 27 21:14:52.865802 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: Mon Jun 27 21:14:52 2022 - graceful shutdown triggered... Jun 27 21:14:52.866473 dv-cinder-847732-1-iscsi devstack@n-api.service[103348]: Gracefully killing worker 1 (pid: 103348)... Jun 27 21:14:52.869076 dv-cinder-847732-1-iscsi devstack@n-api.service[103349]: Gracefully killing worker 2 (pid: 103349)... Jun 27 21:14:53.867098 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: worker 1 buried after 1 seconds Jun 27 21:14:53.867098 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: worker 2 buried after 1 seconds Jun 27 21:14:53.867098 dv-cinder-847732-1-iscsi devstack@n-api.service[103347]: goodbye to uWSGI. Jun 27 21:14:53.868776 dv-cinder-847732-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 27 21:14:53.869380 dv-cinder-847732-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 27 21:14:53.872260 dv-cinder-847732-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 27 21:14:53.882281 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 27 21:14:53.884305 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 27 21:14:53 2022] *** Jun 27 21:14:53.884305 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 27 21:14:53.884305 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 27 21:14:53.884305 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: nodename: dv-cinder-847732-1-iscsi Jun 27 21:14:53.884305 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: machine: x86_64 Jun 27 21:14:53.884305 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: clock source: unix Jun 27 21:14:53.884305 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: pcre jit disabled Jun 27 21:14:53.884305 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: detected number of CPU cores: 4 Jun 27 21:14:53.884305 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: current working directory: / Jun 27 21:14:53.884305 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: detected binary path: /usr/bin/uwsgi-core Jun 27 21:14:53.884305 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: your processes number limit is 47680 Jun 27 21:14:53.885210 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: your memory page size is 4096 bytes Jun 27 21:14:53.885210 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: detected max file descriptor number: 2048 Jun 27 21:14:53.885210 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: lock engine: pthread robust mutexes Jun 27 21:14:53.885210 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: thunder lock: enabled Jun 27 21:14:53.885210 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 27 21:14:53.885210 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 27 21:14:53.930389 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: Python main interpreter initialized at 0x55a2a94fb9c0 Jun 27 21:14:53.930389 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: python threads support enabled Jun 27 21:14:53.930389 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: your server socket listen backlog is limited to 100 connections Jun 27 21:14:53.930389 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: your mercy for graceful operations on workers is 90 seconds Jun 27 21:14:53.930772 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: mapped 403077 bytes (393 KB) for 2 cores Jun 27 21:14:53.930850 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: *** Operational MODE: preforking *** Jun 27 21:14:53.931147 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: *** uWSGI is running in multiple interpreter mode *** Jun 27 21:14:53.931147 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: spawned uWSGI master process (pid: 117876) Jun 27 21:14:53.931354 dv-cinder-847732-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 27 21:14:53.933643 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: spawned uWSGI worker 1 (pid: 117889, cores: 1) Jun 27 21:14:53.934167 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: spawned uWSGI worker 2 (pid: 117891, cores: 1) Jun 27 21:14:53.934408 dv-cinder-847732-1-iscsi devstack@n-api.service[117876]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 27 21:14:54.634241 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 21:14:54.704316 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 21:14:55.851758 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 21:14:55.851758 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: from cryptography.utils import int_from_bytes Jun 27 21:14:55.852408 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 21:14:55.852408 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: from cryptography.utils import int_from_bytes Jun 27 21:14:55.946440 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 21:14:55.946440 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: from cryptography.utils import int_from_bytes Jun 27 21:14:55.947088 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 21:14:55.947088 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: from cryptography.utils import int_from_bytes Jun 27 21:14:58.437536 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 21:14:58.438415 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 21:14:58.438415 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 21:14:58.438727 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 21:14:58.438880 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 21:14:58.439192 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.439506 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.439821 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.440151 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.440483 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.440795 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.441153 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.441466 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.441792 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.442054 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.442371 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.442695 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847732-1-iscsi {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.443019 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.443326 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.443636 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.443958 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.444263 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.444585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.444892 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.445423 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.445870 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.446180 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.446519 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.446834 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.447152 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.447472 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.447796 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.448107 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.448538 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.449106 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.449412 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847732-1-iscsi {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.449735 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.450057 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.450373 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.450804 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.451126 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.451435 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.451759 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.452084 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.452390 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.452730 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.453818 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.454188 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.454534 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.454857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.455182 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.455509 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.455841 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.456199 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.456449 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.456693 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.457122 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.457422 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.460810 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.460810 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.460810 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.460810 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.460810 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.460810 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.462371 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.462371 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.462371 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.462371 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.462371 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.462371 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.462371 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.462371 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.464153 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.464153 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.464153 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.464153 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.464153 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.464153 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.464153 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.464153 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.466247 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.466247 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.466247 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.466247 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.466247 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.466247 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.467592 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.467592 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.467592 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.467592 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.468451 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.468451 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.468451 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.469133 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.469133 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.469578 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.469578 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.470045 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.470045 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.470488 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.470788 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.473202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.473202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.473202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.473202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.473202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.473202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.473202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.474719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.474719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.474719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.474719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.474719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.475796 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.475796 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.475796 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.478771 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.478771 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.478771 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.478771 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.478771 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.478771 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.478771 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.478771 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.480479 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.480479 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.480479 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.480479 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.480479 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.480479 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.480479 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.482138 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.482138 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.482138 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.482138 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.482138 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.483051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.483051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.483051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.483605 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.483605 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.485417 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.485417 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.485417 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.485417 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.485417 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.486634 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.486634 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.486634 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.487223 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.487223 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.487620 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.487620 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.488019 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.488240 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.488541 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.488863 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.489251 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.489578 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.489898 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.490219 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.490533 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.490851 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.491202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.491519 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.491832 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.492179 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.492529 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.492845 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.493324 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.493559 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.494115 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.494465 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.494465 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.494817 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.495158 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.495491 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.495824 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.496187 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.496533 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.496812 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.497184 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.497551 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.497848 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.498169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.498486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.498801 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.499119 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.499431 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.499751 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.500061 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.500372 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.500676 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.501005 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.501320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.501626 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.501954 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.502294 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.502604 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.502942 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.503249 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.503603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.503884 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.504184 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.504487 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.504801 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.505140 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.505448 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.505793 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.506092 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.506399 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.506722 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.507029 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.507333 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.507657 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.507949 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.508262 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.508571 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.508881 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.509259 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.509580 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.509890 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.510231 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.510567 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.510916 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.511244 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.511571 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.511891 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.512194 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.512507 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.512813 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.513155 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.513463 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.513771 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.514075 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.514385 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.514693 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.514998 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.515378 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.515714 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.516027 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.516331 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.516637 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.516969 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.517313 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.517621 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.517973 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.518312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.518636 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.518960 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.519282 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.519608 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.519924 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.520238 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.520557 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.520867 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.521234 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.521549 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.521874 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.522185 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.522522 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.522835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.523161 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.523465 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.523783 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.524128 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.524467 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.524781 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.525131 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.525446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.525763 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.526070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.526386 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.526761 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.527073 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.527392 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.527705 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.528023 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.528334 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.528666 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.529006 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.529327 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.529636 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.529954 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.530287 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.530623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.530932 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.531241 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.531568 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.532085 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.532355 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.532599 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.532839 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.533136 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.533414 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.533731 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.534042 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.534350 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.534653 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.534971 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.535279 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.535856 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.535856 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.536301 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.536536 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.536798 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.537247 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.537476 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.537735 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.538042 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.538363 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.538678 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.538984 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.539292 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.539609 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.539959 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.540271 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.540579 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.540902 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.541249 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.541562 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.541886 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.542347 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.542764 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.543135 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.543534 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.543759 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.544022 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.544337 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.544649 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.545001 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.545323 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.545682 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.545956 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.546271 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.546578 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.546888 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.547214 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.547820 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.548153 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.548469 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.548790 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.549140 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.549467 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.549805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.550132 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.550488 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.550800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.551116 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.551423 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.551728 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.552038 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.552346 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.552656 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.552982 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.553297 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.553603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.553914 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.554223 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.554531 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.554848 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.555155 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.555470 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.555775 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.556385 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.556385 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.556862 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.557167 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.557432 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.557906 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.558441 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.558441 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.558441 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.559581 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.559581 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.559581 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.560277 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.560277 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.560706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.560981 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.561206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.561445 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.561667 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.561978 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.562289 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.562596 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.562907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.563208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.563515 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.563817 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.564144 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.564489 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.564748 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.565089 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.565401 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.565712 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.566015 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.566608 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.566608 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.567054 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.567306 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.567545 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.567829 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.568208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.568433 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.568654 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.569011 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.569325 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.569634 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.569937 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.570246 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.570547 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.570852 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.571158 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.571482 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.571800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.572105 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.572412 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.572704 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.573034 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.573416 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.573701 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.574008 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.574417 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.574736 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.575044 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.575346 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.575679 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.575989 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.576293 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.576609 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.576911 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.577287 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.577597 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.577961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.578291 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.578593 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.578913 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.579227 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.579546 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.579860 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.580167 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.580483 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.580796 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.581135 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.581441 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.581745 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.582810 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.582810 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.582810 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.583480 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.583480 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.583930 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.583930 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.584394 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.584611 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.584845 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.585117 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.585351 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.585667 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.585979 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.586291 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.586606 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.587036 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.587269 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.587501 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.587805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.588111 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.588445 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.588756 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.589266 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.590100 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.590409 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.590724 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.591035 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.591478 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.591793 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.592103 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.592412 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.592725 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.593060 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.593381 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.593707 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.594016 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.594435 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.594749 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.595060 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.595374 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.595686 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.595985 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.596296 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.596622 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.596980 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.597329 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.597635 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.597960 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.598269 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.598593 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.599013 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.599326 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.599641 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.600058 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.600372 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.600685 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.601030 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.601356 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.601678 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.601989 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.602387 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.602629 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.603030 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.603288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.603544 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.603830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.604138 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.604396 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 21:14:58.605372 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.605784 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 21:14:58.606027 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.606027 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.606851 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 21:14:58.607090 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.607503 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 21:14:58.607806 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.608056 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 21:14:58.608305 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.608557 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.608823 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.609099 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.609371 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.609635 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.609881 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.610120 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.610355 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.610596 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.610868 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.611150 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.611396 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.611635 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.611860 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.612098 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.612369 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.612627 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.612864 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.613180 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.613411 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.613663 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.613909 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.614143 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847732-1-iscsi {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.614380 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.614627 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.614883 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.615130 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.615374 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.615629 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.615879 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.616125 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.616380 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.616627 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.616875 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.617147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.617396 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.617829 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.618007 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.618007 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.618320 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.618495 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.618677 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.618846 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.619021 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.619194 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.619342 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.619508 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.619656 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.619936 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.620100 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.620265 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.620521 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.620672 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.620816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.621029 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.621187 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.621321 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.621463 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.621596 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.621741 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.621887 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.622035 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847732-1-iscsi {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.622181 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.622331 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.622526 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.622673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.622819 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.622963 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.623115 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.623292 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.623488 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.623647 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.623802 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.623947 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.624093 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.624236 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.624391 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.624391 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.624654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.624797 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.625017 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.625178 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.625314 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.625450 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.625581 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.625720 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.625855 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.626013 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.626148 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.626276 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.626416 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.626563 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.626697 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.626847 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.626976 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.627096 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.627230 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.627358 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.627483 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.627619 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.627619 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.627886 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.628003 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.628003 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.628003 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.628003 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.628003 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.628003 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.628683 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.628803 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.628961 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.629087 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.629207 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.629363 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.629492 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.629609 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.629738 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.629891 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.630018 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.630018 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.630234 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.630375 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.630500 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.630500 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.630729 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.630845 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.630973 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.630973 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.631208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.631333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.631450 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.631578 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.631702 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.631842 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.631963 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.632088 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.632216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.632335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.632466 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.632466 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.632466 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.632466 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.632466 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.634065 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.634233 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.634415 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.634568 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.634722 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.634869 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.634869 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.635163 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.635301 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.635439 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.635583 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.635741 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.635912 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.636048 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.636196 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.636330 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.636474 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.636639 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.636803 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.637025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.637178 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.637327 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.637492 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.637644 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.637803 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.637953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.638100 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.638261 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.638410 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.638572 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.638734 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.638900 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.639066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.639233 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.639379 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.639527 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.639776 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.639776 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.640068 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.640232 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.640387 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.640387 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.640697 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.640859 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.641058 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.641227 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.641401 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.641568 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.641731 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.641891 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.642056 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.642209 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.642377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.642546 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.642696 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.642848 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.643045 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.643222 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.643773 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.643952 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.644089 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.644243 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.644403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.644560 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.644728 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.644881 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.645135 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.645298 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.645462 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.645628 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.645774 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.645915 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.645915 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.646149 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.646291 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.646482 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.646611 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.646756 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.646884 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.647024 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.647152 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.647289 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.647421 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.647563 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.647710 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.647847 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.647985 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.648126 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.648256 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.648384 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.648522 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.648660 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.648788 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.648955 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.649108 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.649251 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.649381 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.649520 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.649663 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.649799 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.649935 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.650172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.650307 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.650439 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.650580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.650708 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.650838 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.650981 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.651111 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.651242 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.651383 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.651383 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.651698 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.651845 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.651973 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.652092 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.652212 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.652334 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.652472 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.652630 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.652748 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.652880 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.653067 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.653201 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.653339 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.653481 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.653904 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.654057 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.654206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.654343 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.654501 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.654641 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.654784 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.654929 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.655055 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.655055 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.655318 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.655447 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.655576 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.655710 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.655853 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:14:58.656008 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.656152 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.656296 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.656296 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.656536 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.656677 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.656950 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.657188 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.657329 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.657475 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.657610 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.657744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.657891 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.658025 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.658157 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.658291 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.658439 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.658579 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.658731 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.658885 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.658885 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.659157 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.659299 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.659444 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.659592 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.659744 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.659877 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.660009 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.660157 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.660607 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.660756 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.660908 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.660908 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.661182 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.661182 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.661451 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.661451 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.661713 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.661850 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.661996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.662133 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.662293 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.662428 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.662570 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.662706 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.662856 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.662856 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.663111 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.663111 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.663360 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.663360 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.663628 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.664355 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.664512 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.664657 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.664802 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.665004 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.665142 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.665142 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.665433 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.665568 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.665720 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.665906 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.665906 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.666196 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.666348 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.666494 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.666640 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.666784 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.666944 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.667088 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.667088 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.667088 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.667088 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.667088 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.667088 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.667088 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.668046 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.668046 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.668295 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.668425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.668573 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.668711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.668863 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.669068 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.669210 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.669360 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.669511 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.669661 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.669800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.669947 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.670086 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.670239 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.670376 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.670514 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.670664 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.670797 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.670929 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.671070 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.671206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.671339 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.671468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.671614 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.671758 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.671904 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.672061 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.672206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.672365 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.672516 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.672677 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.672809 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.672986 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.673293 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.673493 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.673769 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.674451 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.674451 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.675029 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.675238 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.675388 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.675530 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.675757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.675922 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.676076 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.676226 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.676373 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.676547 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.676716 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.676873 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.677076 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.677224 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.677385 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.677558 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.677714 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.677863 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.678011 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.678169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.678326 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.678499 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.678661 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.678820 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.678984 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.679133 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.679291 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.679458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.679611 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.679760 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.679908 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.680063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.680290 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.680492 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.680688 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.680855 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.681118 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.681118 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.681445 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.681445 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.681752 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.681882 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.682022 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.682176 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.682355 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.682511 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.682676 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.682842 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.683003 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.683157 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.683326 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.683493 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.683646 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.683801 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.683953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.684128 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.684281 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.684475 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.684634 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.684795 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.685425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.685673 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.685844 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.685995 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.686133 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.686290 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.686498 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.686713 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.686907 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.687114 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.687308 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.687481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.687716 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.688009 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.688179 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.688336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.688500 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.688666 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.688831 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.689120 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.689344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.689516 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.689682 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.689848 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.690014 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.690176 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.690333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.690529 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.690725 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.690929 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.691094 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.691239 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.691398 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.691547 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.691761 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.691948 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.692140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.692333 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.692523 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.692741 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.692913 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.693156 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.693312 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.693472 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.693683 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.693883 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.694100 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.694298 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.694506 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.694658 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.694813 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.695029 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.695187 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.695337 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.695517 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.695673 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.695806 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.695971 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.696124 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.696278 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.696432 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.696606 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.696754 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.696917 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.697253 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.697400 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.697559 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.697722 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.697872 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.698036 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.698198 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.698367 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.698596 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.698733 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.698875 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.699011 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.699143 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.699288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.699648 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.699811 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.699977 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.700131 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.700299 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.700441 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.700579 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.700804 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.701050 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.701247 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.701401 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.701563 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.701724 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.701873 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.702058 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.702212 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.702380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.702543 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.702751 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.702915 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.703078 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.703253 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.703408 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.703565 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.703718 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.703898 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.704052 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.704198 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.704358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.704573 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.704734 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.704897 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.705129 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.705314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.705468 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.705634 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.705841 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.706038 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.706189 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.706397 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.706600 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.706795 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.706995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.707191 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.707386 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.707584 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.707770 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.707958 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 21:14:58.708140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.708140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.708140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.708140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.708140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.708140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.708140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.708140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.709572 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.709572 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.709572 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.709572 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.709572 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.709572 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.709572 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.709572 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.710960 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.710960 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.710960 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.710960 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.711691 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.711691 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.712054 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.712054 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.712520 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.712702 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.716711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.716711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.716711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.716711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.716711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.716711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.716711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.716711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.718607 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.718607 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.718607 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.718607 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.718607 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.718607 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.718607 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.720070 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.720070 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.720070 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.720070 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.720070 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.721161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.721161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.721641 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.721641 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.722046 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.722274 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.722615 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.723066 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.723421 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.723738 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.724104 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.724415 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.725171 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.725493 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.725809 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.726122 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.726779 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.726779 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.727044 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.727534 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.727735 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.727964 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.728701 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.729093 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.729415 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.730183 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.730578 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.730889 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.731159 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.731512 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.731866 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.732217 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.732574 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.732954 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.733298 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.733645 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.734005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.734313 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.734640 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.734950 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.735259 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.735568 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.735880 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.736190 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.736501 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.737058 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.737276 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.737486 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.737857 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.738038 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.738351 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.738658 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.738988 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.739303 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.739608 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.739913 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.740226 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.740535 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.740837 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.741195 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.741503 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.741820 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.742125 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.742429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.742731 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.743042 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.743348 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.743655 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.743982 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.744297 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.744599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.744903 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.745282 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.745639 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.745948 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.746254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.746565 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.746916 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.747202 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.747508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.748008 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.748166 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.748407 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.748715 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.749041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.749348 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.749649 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.749955 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.750261 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.750585 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.750894 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.751198 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.751502 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.751806 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.752154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.752461 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.752821 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.753157 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.753472 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.753791 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.754106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.754416 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.754731 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.755041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.755355 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.755666 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.755978 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.756292 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.756625 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.756954 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.757492 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.757806 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.758990 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.761165 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.762133 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.762803 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.763461 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.764117 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.764859 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.765482 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.766047 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.766609 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.767248 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.767859 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.768352 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO dbcounter [None req-737e180a-255f-43df-a46f-16e2f0f31610 None None] Registered counter for database nova_api Jun 27 21:14:58.768608 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.769208 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.769783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.770366 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.770934 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.771508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.772112 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.772675 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.773267 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.773824 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.774456 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.775027 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.775602 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.776383 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.777019 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.777707 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.778129 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.778765 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.779239 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.779808 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.780375 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.781004 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.781830 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.782385 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.782947 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.783508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.784049 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.784587 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.785695 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.787085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.788051 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.789209 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.790074 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.790695 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.791224 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.791809 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.792647 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.793127 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_db.sqlalchemy.engines [None req-737e180a-255f-43df-a46f-16e2f0f31610 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:14:58.793480 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.794207 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.795179 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.795738 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.796297 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.796878 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.797605 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.798159 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.798973 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.799651 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.800102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.800703 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.801028 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writer thread running {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:14:58.801370 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.801861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.802439 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.802992 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.803566 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.804142 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.804710 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.805345 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.806120 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.806703 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.807259 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.807872 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.808681 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.809207 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.809818 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.810826 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.811367 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.811944 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.812526 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.813205 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.813667 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.814233 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.814864 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.815411 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.815957 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.816541 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.817124 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.818119 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.818687 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.819294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.820130 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.820418 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.820963 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.821532 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.822088 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.822647 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.823197 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.824271 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.824756 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.825393 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.825986 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.826503 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.827045 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.827647 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.828235 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.828811 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.829420 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.830232 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.830559 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.831118 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.831673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.832219 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.832739 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.833299 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.833900 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.834370 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.834921 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.835787 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.836334 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.836912 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.837600 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.838104 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.838648 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.840839 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.840839 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.841483 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.841959 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.842466 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.843045 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.843633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.844211 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.844783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.845419 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.845852 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.846434 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.847195 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.847576 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.848152 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.848732 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.849322 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.849892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.850462 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.851256 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.851512 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.852457 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.853121 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.853822 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.854207 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.854843 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.855430 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.856181 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.856733 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.857325 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.858962 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.858962 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.858962 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.859911 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.860164 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.861370 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.861370 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.861370 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.862113 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.862611 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.863132 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.863400 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.context [None req-737e180a-255f-43df-a46f-16e2f0f31610 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9a1fe3d3-e727-4f8a-bdfc-0659bc10e814(cell1) {{(pid=117891) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 21:14:58.863702 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.864260 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.864813 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.865422 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.865977 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.866900 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.867478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.867736 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-737e180a-255f-43df-a46f-16e2f0f31610 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:14:58.868029 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.868573 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.869248 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-737e180a-255f-43df-a46f-16e2f0f31610 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:14:58.869534 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.869962 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.870259 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-737e180a-255f-43df-a46f-16e2f0f31610 None None] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:14:58.870530 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.871611 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.872054 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-737e180a-255f-43df-a46f-16e2f0f31610 None None] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:14:58.872317 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.872767 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.873266 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.873832 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.874474 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.874734 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO dbcounter [None req-737e180a-255f-43df-a46f-16e2f0f31610 None None] Registered counter for database nova_cell0 Jun 27 21:14:58.875044 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.875946 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.876487 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.877114 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.877709 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.878285 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.878808 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.879485 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.879761 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO dbcounter [None req-737e180a-255f-43df-a46f-16e2f0f31610 None None] Registered counter for database nova_cell1 Jun 27 21:14:58.880207 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.880486 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.881065 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.882127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.883188 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.883188 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.883978 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.884417 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.884880 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.885398 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.886466 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.887533 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.887980 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_db.sqlalchemy.engines [None req-737e180a-255f-43df-a46f-16e2f0f31610 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:14:58.888280 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.888699 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.889874 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.895235 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.895235 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.895235 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.895235 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.895235 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.895235 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.895235 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.895235 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.897722 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.897722 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.898434 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writer thread running {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:14:58.898687 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.898933 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_db.sqlalchemy.engines [None req-737e180a-255f-43df-a46f-16e2f0f31610 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:14:58.899201 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.899201 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.899201 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.899201 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.899201 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.900902 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.900902 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.900902 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.901736 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.902007 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.902423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.902967 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.903573 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.904011 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.904555 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.905134 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.905686 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.906241 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.906775 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.907334 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.907951 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.908334 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.908990 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.910138 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.910540 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.911103 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.911691 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.912250 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.912824 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.913481 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.913956 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.914928 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.915483 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.916042 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.916639 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.917491 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.918041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.918968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.919473 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.920360 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.920643 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.920992 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.921555 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.922085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.922640 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.923343 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.923909 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.924373 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.924871 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.925475 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.926085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.926588 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.927134 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.927495 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.927863 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.928429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.929051 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.929555 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.930107 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.930700 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.931181 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.931717 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.932257 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.932840 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.934503 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.934854 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.935404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.935662 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.935921 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.936397 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.936663 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.936916 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.937256 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.937516 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.937845 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.938117 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.938489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.938821 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.939165 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.939619 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.940981 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.940981 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.941265 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.941684 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.942153 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.942719 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.943345 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.943889 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.944432 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.945021 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.945586 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.946199 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.946759 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.947321 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.947907 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.948646 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.949391 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.949942 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.950749 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.951347 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.951901 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.952428 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.953365 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.953609 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.954008 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.954557 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.955098 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.955690 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.956280 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.956867 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.957444 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.958000 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.958576 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.959117 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.959689 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.960249 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.961047 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.961414 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.962000 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.962563 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.963134 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.963869 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.964368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.965246 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.965698 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.966308 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.966900 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.967456 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.968046 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.968608 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.969216 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.969769 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.970329 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.970916 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.971487 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.972094 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.972582 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.973306 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.974052 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.974682 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.975104 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.975432 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.976016 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.976970 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.977542 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.978106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.978735 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.979308 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.980004 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.980531 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.981099 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.981651 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.982262 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:14:58.982622 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 21:14:59.048181 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writer thread running {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:14:59.060611 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO dbcounter [None req-737e180a-255f-43df-a46f-16e2f0f31610 None None] Registered counter for database nova_cell0 Jun 27 21:14:59.068622 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_db.sqlalchemy.engines [None req-737e180a-255f-43df-a46f-16e2f0f31610 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:14:59.074358 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writer thread running {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:14:59.102444 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO dbcounter [None req-fc1992e7-def0-4522-ad2c-c1741f4228ea None None] Registered counter for database nova_api Jun 27 21:14:59.139046 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_db.sqlalchemy.engines [None req-fc1992e7-def0-4522-ad2c-c1741f4228ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:14:59.150812 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writer thread running {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:14:59.265880 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.context [None req-fc1992e7-def0-4522-ad2c-c1741f4228ea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9a1fe3d3-e727-4f8a-bdfc-0659bc10e814(cell1) {{(pid=117889) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 21:14:59.274288 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc1992e7-def0-4522-ad2c-c1741f4228ea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:14:59.277975 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc1992e7-def0-4522-ad2c-c1741f4228ea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:14:59.279468 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc1992e7-def0-4522-ad2c-c1741f4228ea None None] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:14:59.283445 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc1992e7-def0-4522-ad2c-c1741f4228ea None None] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:14:59.287320 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO dbcounter [None req-fc1992e7-def0-4522-ad2c-c1741f4228ea None None] Registered counter for database nova_cell0 Jun 27 21:14:59.295975 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO dbcounter [None req-fc1992e7-def0-4522-ad2c-c1741f4228ea None None] Registered counter for database nova_cell1 Jun 27 21:14:59.308771 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_db.sqlalchemy.engines [None req-fc1992e7-def0-4522-ad2c-c1741f4228ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:14:59.315184 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_db.sqlalchemy.engines [None req-fc1992e7-def0-4522-ad2c-c1741f4228ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:14:59.319794 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writer thread running {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:14:59.402909 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: WARNING keystonemiddleware.auth_token [None req-737e180a-255f-43df-a46f-16e2f0f31610 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 21:14:59.413337 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: WARNING keystonemiddleware.auth_token [None req-737e180a-255f-43df-a46f-16e2f0f31610 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 21:14:59.551154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writer thread running {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:14:59.562208 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO dbcounter [None req-fc1992e7-def0-4522-ad2c-c1741f4228ea None None] Registered counter for database nova_cell0 Jun 27 21:14:59.570222 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_db.sqlalchemy.engines [None req-fc1992e7-def0-4522-ad2c-c1741f4228ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:14:59.576470 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writer thread running {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:14:59.761613 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: WARNING keystonemiddleware.auth_token [None req-737e180a-255f-43df-a46f-16e2f0f31610 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 21:14:59.767856 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: WARNING keystonemiddleware.auth_token [None req-737e180a-255f-43df-a46f-16e2f0f31610 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 21:14:59.773355 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a2a94fb9c0 pid: 117891 (default app) Jun 27 21:14:59.924042 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: WARNING keystonemiddleware.auth_token [None req-fc1992e7-def0-4522-ad2c-c1741f4228ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 21:14:59.934765 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: WARNING keystonemiddleware.auth_token [None req-fc1992e7-def0-4522-ad2c-c1741f4228ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 21:15:00.284537 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: WARNING keystonemiddleware.auth_token [None req-fc1992e7-def0-4522-ad2c-c1741f4228ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 21:15:00.290682 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: WARNING keystonemiddleware.auth_token [None req-fc1992e7-def0-4522-ad2c-c1741f4228ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 21:15:00.296407 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a2a94fb9c0 pid: 117889 (default app) Jun 27 21:15:49.751553 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=3 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:15:49.759764 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=3 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:15:49.760809 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=3 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:15:49.763596 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=3 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:15:50.280307 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-44a07037-1e97-40e3-83e1-4eb9b4050ea0 tempest-VolumesTestJSON-1544981694 tempest-VolumesTestJSON-1544981694-project] Calling method '.version_select at 0x7f83553cfe50>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:51.040311 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-44a07037-1e97-40e3-83e1-4eb9b4050ea0 tempest-VolumesTestJSON-1544981694 tempest-VolumesTestJSON-1544981694-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8b849f24-3910-42b0-a01a-c0ba20f9a11d" status: 200 len: 350 microversion: 2.1 time: 1.302018 Jun 27 21:15:51.047589 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 1/1] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 27 21:15:49 2022] GET /compute/v2.1/os-volumes/8b849f24-3910-42b0-a01a-c0ba20f9a11d => generated 350 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:15:54.233280 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-13fb7df7-45e8-42ec-b5a5-b44ca5f34904 tempest-VolumesTestJSON-1544981694 tempest-VolumesTestJSON-1544981694-project] Calling method '.version_select at 0x7f83553c4430>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:54.268985 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:15:54.270732 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:15:54.272516 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:15:54.273908 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:15:55.099149 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-13fb7df7-45e8-42ec-b5a5-b44ca5f34904 tempest-VolumesTestJSON-1544981694 tempest-VolumesTestJSON-1544981694-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d1645145-0260-4f99-b789-49b8e283bf00" status: 200 len: 350 microversion: 2.1 time: 1.682295 Jun 27 21:15:55.101176 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 1/2] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 27 21:15:53 2022] GET /compute/v2.1/os-volumes/d1645145-0260-4f99-b789-49b8e283bf00 => generated 350 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:15:56.939514 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-25f445d0-9e1c-421a-8d69-a77ccb5a8f64 tempest-VolumesTestJSON-1544981694 tempest-VolumesTestJSON-1544981694-project] Calling method '.version_select at 0x7f83551db280>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:57.157044 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-25f445d0-9e1c-421a-8d69-a77ccb5a8f64 tempest-VolumesTestJSON-1544981694 tempest-VolumesTestJSON-1544981694-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/23f075e8-315b-4055-b353-af84b2bb2eb7" status: 200 len: 351 microversion: 2.1 time: 0.221603 Jun 27 21:15:57.157909 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 27 21:15:56 2022] GET /compute/v2.1/os-volumes/23f075e8-315b-4055-b353-af84b2bb2eb7 => generated 351 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:15:57.170494 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-155eccfc-76cb-4923-b3f8-90c1b68daaee tempest-VolumesTestJSON-1544981694 tempest-VolumesTestJSON-1544981694-project] Calling method '.version_select at 0x7f83551db430>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:57.287368 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2879b242-e067-487f-b54e-d35da5b62891 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-857530094", "imageRef": "3155f228-b1ff-487e-837f-85eec68c250a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:15:57.385181 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-155eccfc-76cb-4923-b3f8-90c1b68daaee tempest-VolumesTestJSON-1544981694 tempest-VolumesTestJSON-1544981694-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.218698 Jun 27 21:15:57.386108 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 3/4] 10.222.0.13 () {58 vars in 1133 bytes} [Mon Jun 27 21:15:57 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:15:57.404793 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8b3b6cc4-491d-4548-afa7-7f5c0db86ecd tempest-VolumesTestJSON-1544981694 tempest-VolumesTestJSON-1544981694-project] Calling method '.version_select at 0x7f83551dbe50>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:57.623909 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.network.neutron [None req-2879b242-e067-487f-b54e-d35da5b62891 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] validate_networks() for [('8e4e94ff-9f19-4780-958f-2bffc629b050', None, None, None, None, None)] {{(pid=117891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:15:57.709556 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8b3b6cc4-491d-4548-afa7-7f5c0db86ecd tempest-VolumesTestJSON-1544981694 tempest-VolumesTestJSON-1544981694-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.312614 Jun 27 21:15:57.710152 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 4/5] 10.222.0.13 () {58 vars in 1148 bytes} [Mon Jun 27 21:15:57 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:15:57.734489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-eade5ae0-83c4-4ca3-a8c8-1953b22ee7ca tempest-VolumesTestJSON-1544981694 tempest-VolumesTestJSON-1544981694-project] Calling method '.version_select at 0x7f83551dbdc0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:58.039343 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-eade5ae0-83c4-4ca3-a8c8-1953b22ee7ca tempest-VolumesTestJSON-1544981694 tempest-VolumesTestJSON-1544981694-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.318699 Jun 27 21:15:58.041248 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 5/6] 10.222.0.13 () {58 vars in 1133 bytes} [Mon Jun 27 21:15:57 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:15:58.053552 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e1c98cfe-4c72-4cf0-a08f-f974de980581 tempest-VolumesTestJSON-1544981694 tempest-VolumesTestJSON-1544981694-project] Calling method '.version_select at 0x7f83551db550>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:58.224085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e1c98cfe-4c72-4cf0-a08f-f974de980581 tempest-VolumesTestJSON-1544981694 tempest-VolumesTestJSON-1544981694-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.175442 Jun 27 21:15:58.224986 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 6/7] 10.222.0.13 () {58 vars in 1166 bytes} [Mon Jun 27 21:15:58 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:15:58.236981 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-79069bca-0cec-400b-8c57-ce4825d7f9f1 tempest-VolumesTestJSON-1544981694 tempest-VolumesTestJSON-1544981694-project] Calling method '.version_select at 0x7f83551e7a60>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:58.449645 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-79069bca-0cec-400b-8c57-ce4825d7f9f1 tempest-VolumesTestJSON-1544981694 tempest-VolumesTestJSON-1544981694-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.216380 Jun 27 21:15:58.451081 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 7/8] 10.222.0.13 () {58 vars in 1169 bytes} [Mon Jun 27 21:15:58 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:15:58.465602 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-669d08f3-0930-490b-bb17-396a05958ddb tempest-VolumesTestJSON-1544981694 tempest-VolumesTestJSON-1544981694-project] Calling method '.version_select at 0x7f83551e79d0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:58.765223 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-669d08f3-0930-490b-bb17-396a05958ddb tempest-VolumesTestJSON-1544981694 tempest-VolumesTestJSON-1544981694-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.305814 Jun 27 21:15:58.766275 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 8/9] 10.222.0.13 () {58 vars in 1154 bytes} [Mon Jun 27 21:15:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:15:58.780294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5c3ed438-fafa-4e08-9996-406aa39a1afa tempest-VolumesTestJSON-1544981694 tempest-VolumesTestJSON-1544981694-project] Calling method '.version_select at 0x7f83551db4c0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:59.077898 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5c3ed438-fafa-4e08-9996-406aa39a1afa tempest-VolumesTestJSON-1544981694 tempest-VolumesTestJSON-1544981694-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.303125 Jun 27 21:15:59.080348 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 9/10] 10.222.0.13 () {58 vars in 1187 bytes} [Mon Jun 27 21:15:58 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:15:59.096622 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-baa3475c-2885-48a8-8859-e810f06185f4 tempest-VolumesTestJSON-1544981694 tempest-VolumesTestJSON-1544981694-project] Calling method '.version_select at 0x7f83551dbf70>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:59.424411 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-baa3475c-2885-48a8-8859-e810f06185f4 tempest-VolumesTestJSON-1544981694 tempest-VolumesTestJSON-1544981694-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.333972 Jun 27 21:15:59.425788 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 10/11] 10.222.0.13 () {58 vars in 1154 bytes} [Mon Jun 27 21:15:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:00.193701 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-2879b242-e067-487f-b54e-d35da5b62891 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Flavor limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:16:00.194795 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-2879b242-e067-487f-b54e-d35da5b62891 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Image limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:16:00.195417 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-2879b242-e067-487f-b54e-d35da5b62891 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Flavor pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:16:00.195956 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-2879b242-e067-487f-b54e-d35da5b62891 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Image pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:16:00.196537 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-2879b242-e067-487f-b54e-d35da5b62891 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:16:00.249951 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2879b242-e067-487f-b54e-d35da5b62891 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:00.250387 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2879b242-e067-487f-b54e-d35da5b62891 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:00.251191 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2879b242-e067-487f-b54e-d35da5b62891 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:00.251620 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2879b242-e067-487f-b54e-d35da5b62891 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:00.359850 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-2879b242-e067-487f-b54e-d35da5b62891 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Getting quotas for project a2a3853bab51428eb89ff228e5f29ef4. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:16:00.375729 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-2879b242-e067-487f-b54e-d35da5b62891 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Getting quotas for user a0408ee5961249d1bd296a6ef1a030a9 and project a2a3853bab51428eb89ff228e5f29ef4. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:16:00.427063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2879b242-e067-487f-b54e-d35da5b62891 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Going to run 1 instances... {{(pid=117891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:16:00.434511 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2879b242-e067-487f-b54e-d35da5b62891 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3155f228-b1ff-487e-837f-85eec68c250a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:16:00.566725 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2879b242-e067-487f-b54e-d35da5b62891 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.743990 Jun 27 21:16:00.576714 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 2/12] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 27 21:15:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 3754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:16:00.584081 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5281bd23-e9f1-4f9d-b31a-d611e322c505 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:00.588622 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5281bd23-e9f1-4f9d-b31a-d611e322c505 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:01.250682 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5281bd23-e9f1-4f9d-b31a-d611e322c505 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:01.291844 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5281bd23-e9f1-4f9d-b31a-d611e322c505 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1221 microversion: 2.1 time: 0.717305 Jun 27 21:16:01.308375 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 11/13] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:00 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1221 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:01.643333 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2a4dc6ab-657b-4068-a787-05a75ebe5817 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-933324295", "imageRef": "3155f228-b1ff-487e-837f-85eec68c250a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:01.717927 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.network.neutron [None req-2a4dc6ab-657b-4068-a787-05a75ebe5817 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] validate_networks() for [('8e4e94ff-9f19-4780-958f-2bffc629b050', None, None, None, None, None)] {{(pid=117891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:16:05.127012 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-2a4dc6ab-657b-4068-a787-05a75ebe5817 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Flavor limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:16:05.128530 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-2a4dc6ab-657b-4068-a787-05a75ebe5817 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Image limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:16:05.128530 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-2a4dc6ab-657b-4068-a787-05a75ebe5817 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Flavor pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:16:05.128530 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-2a4dc6ab-657b-4068-a787-05a75ebe5817 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Image pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:16:05.128849 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-2a4dc6ab-657b-4068-a787-05a75ebe5817 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:16:05.180795 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2a4dc6ab-657b-4068-a787-05a75ebe5817 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:05.183404 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2a4dc6ab-657b-4068-a787-05a75ebe5817 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:05.185727 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2a4dc6ab-657b-4068-a787-05a75ebe5817 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:05.192620 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2a4dc6ab-657b-4068-a787-05a75ebe5817 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:05.249670 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-2a4dc6ab-657b-4068-a787-05a75ebe5817 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Getting quotas for project a2a3853bab51428eb89ff228e5f29ef4. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:16:05.264368 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-2a4dc6ab-657b-4068-a787-05a75ebe5817 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Getting quotas for user a0408ee5961249d1bd296a6ef1a030a9 and project a2a3853bab51428eb89ff228e5f29ef4. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:16:05.309703 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2a4dc6ab-657b-4068-a787-05a75ebe5817 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Going to run 1 instances... {{(pid=117891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:16:05.316829 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2a4dc6ab-657b-4068-a787-05a75ebe5817 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3155f228-b1ff-487e-837f-85eec68c250a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:16:05.551487 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2a4dc6ab-657b-4068-a787-05a75ebe5817 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.907868 Jun 27 21:16:05.565455 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 3/14] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 27 21:16:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 3928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:16:05.618186 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-890a349c-5156-4f04-8474-f282776769ab tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:05.624489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-890a349c-5156-4f04-8474-f282776769ab tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:06.006086 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7b7659fc-65f3-493a-bf8d-d2e6678df4dd tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Action: 'create', calling method: .version_select at 0x7f835407bdc0>, body: {"keypair": {"name": "tempest-keypair-1944278523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqn5fp3oEp8tJYEZCRUK1WojVP+1lo0NIuWK75pz4cawHgGnj8hbqWrC3L9+mfaVB7/D6nRdtUTvcJUiYd7cljI+a3nSsuR6nxd6z6XLctm7vKJrokGvtTiviXstu/sAg=="}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:06.059146 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-7b7659fc-65f3-493a-bf8d-d2e6678df4dd tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Getting quotas for project d8c1bcb797ba4eb0ad6daf5ed39baa89. Resources: {'key_pairs'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:16:06.074811 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-7b7659fc-65f3-493a-bf8d-d2e6678df4dd tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Getting quotas for user 7969c6620a0d406890fb4c15b58ab349 and project d8c1bcb797ba4eb0ad6daf5ed39baa89. Resources: {'key_pairs'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:16:06.122532 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-890a349c-5156-4f04-8474-f282776769ab tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:06.130602 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-890a349c-5156-4f04-8474-f282776769ab tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1221 microversion: 2.1 time: 0.560814 Jun 27 21:16:06.151371 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 12/15] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:05 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1221 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:06.191187 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7b7659fc-65f3-493a-bf8d-d2e6678df4dd tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.576683 Jun 27 21:16:06.192096 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 4/16] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 27 21:16:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:07.155016 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2e68803a-260d-46ef-b0b9-78582d1298a8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:07.155996 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2e68803a-260d-46ef-b0b9-78582d1298a8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:07.547499 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2e68803a-260d-46ef-b0b9-78582d1298a8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:07.585623 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2e68803a-260d-46ef-b0b9-78582d1298a8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1221 microversion: 2.1 time: 0.435628 Jun 27 21:16:07.602799 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 13/17] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:07 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1221 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:08.612576 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3fdf420a-41c6-4841-8bb0-2e84466c0896 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:08.613399 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3fdf420a-41c6-4841-8bb0-2e84466c0896 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:08.684739 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3fdf420a-41c6-4841-8bb0-2e84466c0896 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:08.690476 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3fdf420a-41c6-4841-8bb0-2e84466c0896 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:08.692781 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3fdf420a-41c6-4841-8bb0-2e84466c0896 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:08.700782 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3fdf420a-41c6-4841-8bb0-2e84466c0896 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:09.695422 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9d5e23b3-f0c6-4335-881e-42fe5c4d5c34 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Action: 'create', calling method: .version_select at 0x7f83551aeaf0>, body: {"keypair": {"name": "tempest-keypair-4210487", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALbwiU1EpMEWgKkyllbuNgcUkOoEDGg3Ah+/URtRzDjcuopaPRJMizyH3NFdEY7puzBSdX/lJbrGVIRmJYAcLf+WmFN9bA3YIhxTYlqkoL9bEL/XRQF5W7+EwhbA9iMZg=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:09.889908 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-9d5e23b3-f0c6-4335-881e-42fe5c4d5c34 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Getting quotas for project 4a74724882c84e8f893f5be0f59a9581. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:16:09.918994 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3fdf420a-41c6-4841-8bb0-2e84466c0896 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:09.961444 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-9d5e23b3-f0c6-4335-881e-42fe5c4d5c34 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Getting quotas for user fff9f1fc84a54b83a7a384965f40c9d9 and project 4a74724882c84e8f893f5be0f59a9581. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:16:09.980984 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3fdf420a-41c6-4841-8bb0-2e84466c0896 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1281 microversion: 2.1 time: 1.376634 Jun 27 21:16:10.004779 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 5/18] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:08 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1281 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:10.171374 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9d5e23b3-f0c6-4335-881e-42fe5c4d5c34 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.862679 Jun 27 21:16:10.180726 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 14/19] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 27 21:16:09 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:16:10.535154 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-bba654f6-7d10-423f-ac64-c880fecaf6e3 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2125903084", "imageRef": "3155f228-b1ff-487e-837f-85eec68c250a", "flavorRef": "452", "networks": [{"uuid": "aa6461c8-2490-4225-82bb-7e18f2ed61f3"}]}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:10.637178 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.network.neutron [None req-bba654f6-7d10-423f-ac64-c880fecaf6e3 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] validate_networks() for [('aa6461c8-2490-4225-82bb-7e18f2ed61f3', None, None, None, None, None)] {{(pid=117891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:16:11.040119 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c8d7088f-395e-4fc1-9000-b2a7ac5b19de tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:11.043866 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c8d7088f-395e-4fc1-9000-b2a7ac5b19de tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:11.084055 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c8d7088f-395e-4fc1-9000-b2a7ac5b19de tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:11.084514 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c8d7088f-395e-4fc1-9000-b2a7ac5b19de tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:11.086492 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c8d7088f-395e-4fc1-9000-b2a7ac5b19de tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:11.089701 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c8d7088f-395e-4fc1-9000-b2a7ac5b19de tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:11.614274 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c8d7088f-395e-4fc1-9000-b2a7ac5b19de tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:11.638042 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c8d7088f-395e-4fc1-9000-b2a7ac5b19de tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1279 microversion: 2.1 time: 0.630714 Jun 27 21:16:11.641630 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 15/20] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:11 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1279 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:12.671324 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b6b286bd-3545-426b-81ee-a5bd0bb082ac tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:12.671324 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b6b286bd-3545-426b-81ee-a5bd0bb082ac tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:12.714454 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6b286bd-3545-426b-81ee-a5bd0bb082ac tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:12.726470 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6b286bd-3545-426b-81ee-a5bd0bb082ac tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:12.727458 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6b286bd-3545-426b-81ee-a5bd0bb082ac tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:12.731191 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6b286bd-3545-426b-81ee-a5bd0bb082ac tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:13.004756 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b6b286bd-3545-426b-81ee-a5bd0bb082ac tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:13.022518 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b6b286bd-3545-426b-81ee-a5bd0bb082ac tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1279 microversion: 2.1 time: 0.355611 Jun 27 21:16:13.035091 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 16/21] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:12 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1279 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:14.040306 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-dc6a092b-2ea0-4ea6-b342-f6a7c3154555 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:14.041476 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-dc6a092b-2ea0-4ea6-b342-f6a7c3154555 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:14.061626 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dc6a092b-2ea0-4ea6-b342-f6a7c3154555 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:14.066943 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dc6a092b-2ea0-4ea6-b342-f6a7c3154555 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:14.070248 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dc6a092b-2ea0-4ea6-b342-f6a7c3154555 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:14.070739 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dc6a092b-2ea0-4ea6-b342-f6a7c3154555 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:14.444299 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-dc6a092b-2ea0-4ea6-b342-f6a7c3154555 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:14.461523 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-dc6a092b-2ea0-4ea6-b342-f6a7c3154555 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1279 microversion: 2.1 time: 0.424908 Jun 27 21:16:14.477559 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 17/22] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:14 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1279 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:14.844405 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8268117c-f034-4402-8902-306ca20027ec tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1665260841", "imageRef": "3155f228-b1ff-487e-837f-85eec68c250a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ab36d48-170c-4f48-af11-d6da9c4061e0"}], "security_groups": [{"name": "tempest-securitygroup--1747065259"}], "key_name": "tempest-keypair-1944278523", "user_data": "}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:15.160315 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-bba654f6-7d10-423f-ac64-c880fecaf6e3 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Flavor limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:16:15.160852 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-bba654f6-7d10-423f-ac64-c880fecaf6e3 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Image limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:16:15.161650 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-bba654f6-7d10-423f-ac64-c880fecaf6e3 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Flavor pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:16:15.162258 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-bba654f6-7d10-423f-ac64-c880fecaf6e3 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Image pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:16:15.162919 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-bba654f6-7d10-423f-ac64-c880fecaf6e3 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:16:15.209711 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bba654f6-7d10-423f-ac64-c880fecaf6e3 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:15.217025 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bba654f6-7d10-423f-ac64-c880fecaf6e3 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:15.219814 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bba654f6-7d10-423f-ac64-c880fecaf6e3 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:15.224238 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bba654f6-7d10-423f-ac64-c880fecaf6e3 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:15.245816 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=4 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:15.367717 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-bba654f6-7d10-423f-ac64-c880fecaf6e3 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Getting quotas for project a2e58fc8b6e14185b4409884a5701316. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:16:15.392084 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-bba654f6-7d10-423f-ac64-c880fecaf6e3 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Getting quotas for user db0e1b60083640bd89b9b4287fdb9d28 and project a2e58fc8b6e14185b4409884a5701316. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:16:15.465300 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-bba654f6-7d10-423f-ac64-c880fecaf6e3 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Going to run 1 instances... {{(pid=117891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:16:15.471637 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-bba654f6-7d10-423f-ac64-c880fecaf6e3 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3155f228-b1ff-487e-837f-85eec68c250a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:16:15.683469 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-bba654f6-7d10-423f-ac64-c880fecaf6e3 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.677415 Jun 27 21:16:15.692067 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 6/23] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 27 21:16:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 5687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:16:15.705072 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-aa7b0d2b-6fac-4f51-843e-f4bb8dbbad85 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:15.705688 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-aa7b0d2b-6fac-4f51-843e-f4bb8dbbad85 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:15.741833 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-aa7b0d2b-6fac-4f51-843e-f4bb8dbbad85 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:15.742283 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-aa7b0d2b-6fac-4f51-843e-f4bb8dbbad85 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:15.743083 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-aa7b0d2b-6fac-4f51-843e-f4bb8dbbad85 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:15.743503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-aa7b0d2b-6fac-4f51-843e-f4bb8dbbad85 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:16.149252 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-aa7b0d2b-6fac-4f51-843e-f4bb8dbbad85 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:16.164845 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-aa7b0d2b-6fac-4f51-843e-f4bb8dbbad85 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1279 microversion: 2.1 time: 0.470559 Jun 27 21:16:16.169364 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 7/24] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:15 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1279 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:16.194639 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f3fdc61f-6e0f-41c5-b819-577e7dfe9e2e tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:16.197168 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f3fdc61f-6e0f-41c5-b819-577e7dfe9e2e tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:16.389065 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f3fdc61f-6e0f-41c5-b819-577e7dfe9e2e tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:16.428416 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f3fdc61f-6e0f-41c5-b819-577e7dfe9e2e tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1215 microversion: 2.1 time: 0.249901 Jun 27 21:16:16.430529 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 8/25] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:16 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1215 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:16.778724 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-8268117c-f034-4402-8902-306ca20027ec tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] validate_networks() for [('1ab36d48-170c-4f48-af11-d6da9c4061e0', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:16:17.185819 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6e1053ca-9b11-45d4-92e3-5da1869237a8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:17.186718 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6e1053ca-9b11-45d4-92e3-5da1869237a8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:17.219298 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6e1053ca-9b11-45d4-92e3-5da1869237a8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:17.219768 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6e1053ca-9b11-45d4-92e3-5da1869237a8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:17.220661 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6e1053ca-9b11-45d4-92e3-5da1869237a8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:17.221203 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6e1053ca-9b11-45d4-92e3-5da1869237a8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:17.417449 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-6e1053ca-9b11-45d4-92e3-5da1869237a8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:17.429827 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6e1053ca-9b11-45d4-92e3-5da1869237a8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1279 microversion: 2.1 time: 0.248754 Jun 27 21:16:17.444813 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 9/26] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:17 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1279 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:17.458032 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-23cc1534-ee1a-41ef-ad0e-1d4d9100601a tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:17.458956 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-23cc1534-ee1a-41ef-ad0e-1d4d9100601a tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:17.469130 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-23cc1534-ee1a-41ef-ad0e-1d4d9100601a tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:17.469869 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-23cc1534-ee1a-41ef-ad0e-1d4d9100601a tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:17.478551 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-23cc1534-ee1a-41ef-ad0e-1d4d9100601a tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:17.479543 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-23cc1534-ee1a-41ef-ad0e-1d4d9100601a tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:17.642534 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-23cc1534-ee1a-41ef-ad0e-1d4d9100601a tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:17.682916 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-23cc1534-ee1a-41ef-ad0e-1d4d9100601a tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1219 microversion: 2.1 time: 0.234322 Jun 27 21:16:17.690282 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 10/27] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:17 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1219 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:18.446985 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3b8ac928-badd-454b-905b-006785f412bd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:18.447675 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3b8ac928-badd-454b-905b-006785f412bd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:18.470500 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3b8ac928-badd-454b-905b-006785f412bd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:18.474316 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3b8ac928-badd-454b-905b-006785f412bd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:18.477105 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3b8ac928-badd-454b-905b-006785f412bd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:18.477604 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3b8ac928-badd-454b-905b-006785f412bd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:18.825407 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3b8ac928-badd-454b-905b-006785f412bd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:18.840693 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3b8ac928-badd-454b-905b-006785f412bd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1321 microversion: 2.1 time: 0.397443 Jun 27 21:16:18.842741 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 11/28] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:18 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1321 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:18.848278 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-fc818dc2-c73d-4d61-94ec-a3d5eb81b999 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:18.849273 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-fc818dc2-c73d-4d61-94ec-a3d5eb81b999 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:18.872752 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fc818dc2-c73d-4d61-94ec-a3d5eb81b999 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:18.873707 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fc818dc2-c73d-4d61-94ec-a3d5eb81b999 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:18.892896 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fc818dc2-c73d-4d61-94ec-a3d5eb81b999 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:18.894767 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fc818dc2-c73d-4d61-94ec-a3d5eb81b999 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:19.175221 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-fc818dc2-c73d-4d61-94ec-a3d5eb81b999 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:19.189284 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-fc818dc2-c73d-4d61-94ec-a3d5eb81b999 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1219 microversion: 2.1 time: 0.345085 Jun 27 21:16:19.190092 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 12/29] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:18 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1219 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:19.442994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-8268117c-f034-4402-8902-306ca20027ec tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:16:19.442994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-8268117c-f034-4402-8902-306ca20027ec tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:16:19.443547 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-8268117c-f034-4402-8902-306ca20027ec tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:16:19.443620 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-8268117c-f034-4402-8902-306ca20027ec tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:16:19.445114 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-8268117c-f034-4402-8902-306ca20027ec tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:16:19.477982 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8268117c-f034-4402-8902-306ca20027ec tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:19.480126 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8268117c-f034-4402-8902-306ca20027ec tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:19.486987 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8268117c-f034-4402-8902-306ca20027ec tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:19.487493 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8268117c-f034-4402-8902-306ca20027ec tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:19.499319 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c0cbe1b3-a969-4a0a-a850-76f481a04236 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Action: 'create', calling method: .version_select at 0x7f834f746c10>, body: {"keypair": {"name": "tempest-keypair-2107055284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5A7YVYXrCTJgQI93Ni2ITiYjfjuXb1gc82DgUsKkrcI2VHibdY8+8dGvLW6vqbofiVBDjDeNM9uFWvqplM+Q+AIqq9b1Bn6Yyq5zJHtNXRvs+jdPtlyPk8dTB0cij1Uw=="}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:19.539845 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-c0cbe1b3-a969-4a0a-a850-76f481a04236 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Getting quotas for project 0cdaf724b92644a0ae7fbb71147aef40. Resources: {'key_pairs'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:16:19.565539 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-c0cbe1b3-a969-4a0a-a850-76f481a04236 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Getting quotas for user ba0127dd69da407ab096773fc9e22530 and project 0cdaf724b92644a0ae7fbb71147aef40. Resources: {'key_pairs'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:16:19.620487 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-8268117c-f034-4402-8902-306ca20027ec tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Getting quotas for project d8c1bcb797ba4eb0ad6daf5ed39baa89. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:16:19.641127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-8268117c-f034-4402-8902-306ca20027ec tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Getting quotas for user 7969c6620a0d406890fb4c15b58ab349 and project d8c1bcb797ba4eb0ad6daf5ed39baa89. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:16:19.649238 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c0cbe1b3-a969-4a0a-a850-76f481a04236 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.456092 Jun 27 21:16:19.650556 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 13/30] 10.222.0.13 () {62 vars in 1199 bytes} [Mon Jun 27 21:16:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 460 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 27 21:16:19.694472 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8268117c-f034-4402-8902-306ca20027ec tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:16:19.701051 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8268117c-f034-4402-8902-306ca20027ec tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3155f228-b1ff-487e-837f-85eec68c250a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:16:19.863356 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-378d677e-7ac8-4e06-8002-05bcfed56925 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:19.865343 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-378d677e-7ac8-4e06-8002-05bcfed56925 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:19.902795 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-378d677e-7ac8-4e06-8002-05bcfed56925 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:19.903588 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-378d677e-7ac8-4e06-8002-05bcfed56925 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:19.905771 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-378d677e-7ac8-4e06-8002-05bcfed56925 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:19.913415 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-378d677e-7ac8-4e06-8002-05bcfed56925 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:19.959052 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8268117c-f034-4402-8902-306ca20027ec tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.126989 Jun 27 21:16:19.968416 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 18/31] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 27 21:16:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 5138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:16:20.005731 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3c3b508a-a946-43ae-b169-bd21cfa5ef12 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:20.008172 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3c3b508a-a946-43ae-b169-bd21cfa5ef12 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:20.523000 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-378d677e-7ac8-4e06-8002-05bcfed56925 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:20.528008 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=47 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:20.550350 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-378d677e-7ac8-4e06-8002-05bcfed56925 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1321 microversion: 2.1 time: 0.688431 Jun 27 21:16:20.551543 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 14/32] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:19 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1321 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:20.595788 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7e651abb-d541-41bc-ab8d-facd322bdca9 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:20.598755 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7e651abb-d541-41bc-ab8d-facd322bdca9 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:20.614771 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=11 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:20.643953 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7e651abb-d541-41bc-ab8d-facd322bdca9 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:20.644418 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7e651abb-d541-41bc-ab8d-facd322bdca9 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:20.657680 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7e651abb-d541-41bc-ab8d-facd322bdca9 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:20.659239 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7e651abb-d541-41bc-ab8d-facd322bdca9 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:20.840292 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3c3b508a-a946-43ae-b169-bd21cfa5ef12 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:20.862196 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3c3b508a-a946-43ae-b169-bd21cfa5ef12 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1238 microversion: 2.1 time: 0.876233 Jun 27 21:16:20.864463 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 19/33] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:19 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1238 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:21.111913 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-9c73a6aa-59ef-422a-a0ae-856584e4e743 req-9a840358-872b-4de2-ac39-ef70ea9675e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53419a08-6ab0-4f25-82f9-81496ca7440e", "tag": "e0071d9d-e534-4717-a5e1-b60e19b215c7"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:21.154797 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7e651abb-d541-41bc-ab8d-facd322bdca9 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:21.161931 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-9c73a6aa-59ef-422a-a0ae-856584e4e743 req-9a840358-872b-4de2-ac39-ef70ea9675e0 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:21.163901 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-9c73a6aa-59ef-422a-a0ae-856584e4e743 req-9a840358-872b-4de2-ac39-ef70ea9675e0 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:21.193908 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7e651abb-d541-41bc-ab8d-facd322bdca9 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1211 microversion: 2.1 time: 0.638951 Jun 27 21:16:21.225034 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 15/34] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:20 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1211 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:21.257759 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-9c73a6aa-59ef-422a-a0ae-856584e4e743 req-9a840358-872b-4de2-ac39-ef70ea9675e0 service nova] Creating event network-changed:e0071d9d-e534-4717-a5e1-b60e19b215c7 for instance 53419a08-6ab0-4f25-82f9-81496ca7440e on hv-cinder-84773 Jun 27 21:16:21.261364 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-9c73a6aa-59ef-422a-a0ae-856584e4e743 req-9a840358-872b-4de2-ac39-ef70ea9675e0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117889) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 27 21:16:21.265079 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-794e8684-cf76-481f-9957-044a36f9a12f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:21.266581 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-794e8684-cf76-481f-9957-044a36f9a12f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:21.267855 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-794e8684-cf76-481f-9957-044a36f9a12f None None] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:21.269749 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-794e8684-cf76-481f-9957-044a36f9a12f None None] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:21.302846 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.compute.rpcapi [None req-794e8684-cf76-481f-9957-044a36f9a12f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 27 21:16:21.305015 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-794e8684-cf76-481f-9957-044a36f9a12f None None] Releasing lock "compute-rpcapi-router" {{(pid=117889) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 27 21:16:21.424836 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-794e8684-cf76-481f-9957-044a36f9a12f None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.558044 Jun 27 21:16:21.425869 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 20/35] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:21.569807 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4b700e0b-e786-434b-a40a-5cfbc62bfd16 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:21.570487 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4b700e0b-e786-434b-a40a-5cfbc62bfd16 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:21.587330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4b700e0b-e786-434b-a40a-5cfbc62bfd16 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:21.589404 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4b700e0b-e786-434b-a40a-5cfbc62bfd16 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:21.590439 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4b700e0b-e786-434b-a40a-5cfbc62bfd16 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:21.590879 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4b700e0b-e786-434b-a40a-5cfbc62bfd16 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:21.866899 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4b700e0b-e786-434b-a40a-5cfbc62bfd16 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:21.880983 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4b700e0b-e786-434b-a40a-5cfbc62bfd16 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1321 microversion: 2.1 time: 0.315018 Jun 27 21:16:21.881928 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cb20982c-6f02-415f-8408-288c6b3077ef tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:21.882967 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 16/36] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:21 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:21.883526 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cb20982c-6f02-415f-8408-288c6b3077ef tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:21.895314 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb20982c-6f02-415f-8408-288c6b3077ef tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:21.896230 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb20982c-6f02-415f-8408-288c6b3077ef tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:21.899639 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb20982c-6f02-415f-8408-288c6b3077ef tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:21.902464 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb20982c-6f02-415f-8408-288c6b3077ef tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:22.086572 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cb20982c-6f02-415f-8408-288c6b3077ef tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:22.099499 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cb20982c-6f02-415f-8408-288c6b3077ef tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1234 microversion: 2.1 time: 0.222636 Jun 27 21:16:22.100685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 21/37] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:21 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1234 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:22.215185 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-01f0108b-4168-4a4b-9eed-290c7fae1d18 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:22.216407 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-01f0108b-4168-4a4b-9eed-290c7fae1d18 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:22.226984 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-01f0108b-4168-4a4b-9eed-290c7fae1d18 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:22.233594 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-01f0108b-4168-4a4b-9eed-290c7fae1d18 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:22.234418 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-01f0108b-4168-4a4b-9eed-290c7fae1d18 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:22.234848 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-01f0108b-4168-4a4b-9eed-290c7fae1d18 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:22.347108 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-01f0108b-4168-4a4b-9eed-290c7fae1d18 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:22.358375 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-01f0108b-4168-4a4b-9eed-290c7fae1d18 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1275 microversion: 2.1 time: 0.148390 Jun 27 21:16:22.362088 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 17/38] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:22 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1275 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:22.767858 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7bc6307f-b6ba-40f7-968f-5c45aeadb3c6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2147378583", "imageRef": "3155f228-b1ff-487e-837f-85eec68c250a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88eac9a2-e4a8-414f-a6be-c486870814c1"}], "security_groups": [{"name": "tempest-securitygroup--1589239750"}], "key_name": "tempest-keypair-4210487", "user_data": "}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:22.898953 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3f7dfbd5-9692-44b4-855b-4d1c8b314863 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:22.899561 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3f7dfbd5-9692-44b4-855b-4d1c8b314863 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:22.906762 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3f7dfbd5-9692-44b4-855b-4d1c8b314863 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:22.907481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3f7dfbd5-9692-44b4-855b-4d1c8b314863 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:22.908423 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3f7dfbd5-9692-44b4-855b-4d1c8b314863 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:22.909029 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3f7dfbd5-9692-44b4-855b-4d1c8b314863 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:23.036335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-7bc6307f-b6ba-40f7-968f-5c45aeadb3c6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] validate_networks() for [('88eac9a2-e4a8-414f-a6be-c486870814c1', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:16:23.125861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3f7dfbd5-9692-44b4-855b-4d1c8b314863 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:23.146374 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3f7dfbd5-9692-44b4-855b-4d1c8b314863 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1321 microversion: 2.1 time: 0.251497 Jun 27 21:16:23.160216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 18/39] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:22 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:23.180371 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3ed04cfc-1d08-4a2f-bc1c-1e09fb100a1a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:23.184881 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3ed04cfc-1d08-4a2f-bc1c-1e09fb100a1a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:23.207611 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3ed04cfc-1d08-4a2f-bc1c-1e09fb100a1a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:23.208081 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3ed04cfc-1d08-4a2f-bc1c-1e09fb100a1a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:23.208866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3ed04cfc-1d08-4a2f-bc1c-1e09fb100a1a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:23.209331 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3ed04cfc-1d08-4a2f-bc1c-1e09fb100a1a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:23.330041 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3ed04cfc-1d08-4a2f-bc1c-1e09fb100a1a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:23.340448 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3ed04cfc-1d08-4a2f-bc1c-1e09fb100a1a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1234 microversion: 2.1 time: 0.177771 Jun 27 21:16:23.342485 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 19/40] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:23 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1234 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:23.379901 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ffbe4357-c65d-4a0a-ba97-041e904b37a6 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:23.380609 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ffbe4357-c65d-4a0a-ba97-041e904b37a6 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:23.390251 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ffbe4357-c65d-4a0a-ba97-041e904b37a6 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:23.392717 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ffbe4357-c65d-4a0a-ba97-041e904b37a6 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:23.393777 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ffbe4357-c65d-4a0a-ba97-041e904b37a6 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:23.396409 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ffbe4357-c65d-4a0a-ba97-041e904b37a6 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:23.547925 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ffbe4357-c65d-4a0a-ba97-041e904b37a6 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:23.559995 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ffbe4357-c65d-4a0a-ba97-041e904b37a6 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1275 microversion: 2.1 time: 0.184932 Jun 27 21:16:23.566110 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 20/41] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:23 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1275 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:23.949238 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-cb867207-79a0-4f83-92df-c812aaac170f req-e6e4ea66-889a-4518-887d-2b98fbe6ace3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d240a8f-534e-471d-817b-3d79b449bfeb", "tag": "a6130374-d711-4d19-a701-67a2bc874882"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:23.975306 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-cb867207-79a0-4f83-92df-c812aaac170f req-e6e4ea66-889a-4518-887d-2b98fbe6ace3 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:23.976597 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-cb867207-79a0-4f83-92df-c812aaac170f req-e6e4ea66-889a-4518-887d-2b98fbe6ace3 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:24.011759 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-cb867207-79a0-4f83-92df-c812aaac170f req-e6e4ea66-889a-4518-887d-2b98fbe6ace3 service nova] Creating event network-changed:a6130374-d711-4d19-a701-67a2bc874882 for instance 4d240a8f-534e-471d-817b-3d79b449bfeb on hv-cinder-84773 Jun 27 21:16:24.013147 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-cb867207-79a0-4f83-92df-c812aaac170f req-e6e4ea66-889a-4518-887d-2b98fbe6ace3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117891) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 27 21:16:24.014520 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ce0795ef-24f2-4d68-acb0-a76e108eda22 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:24.015354 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ce0795ef-24f2-4d68-acb0-a76e108eda22 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:24.016566 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ce0795ef-24f2-4d68-acb0-a76e108eda22 None None] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:24.017970 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ce0795ef-24f2-4d68-acb0-a76e108eda22 None None] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:24.041908 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.compute.rpcapi [None req-ce0795ef-24f2-4d68-acb0-a76e108eda22 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 27 21:16:24.061949 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ce0795ef-24f2-4d68-acb0-a76e108eda22 None None] Releasing lock "compute-rpcapi-router" {{(pid=117891) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 27 21:16:24.127734 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ce0795ef-24f2-4d68-acb0-a76e108eda22 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.363309 Jun 27 21:16:24.140831 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 21/42] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:24.168607 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-023af857-31ac-4974-a8ed-7c4d7a847baf tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:24.169334 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-023af857-31ac-4974-a8ed-7c4d7a847baf tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:24.193620 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-023af857-31ac-4974-a8ed-7c4d7a847baf tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:24.195982 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-023af857-31ac-4974-a8ed-7c4d7a847baf tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:24.197242 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-023af857-31ac-4974-a8ed-7c4d7a847baf tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:24.197795 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-023af857-31ac-4974-a8ed-7c4d7a847baf tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:24.211933 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-7bc6307f-b6ba-40f7-968f-5c45aeadb3c6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:16:24.217391 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-7bc6307f-b6ba-40f7-968f-5c45aeadb3c6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:16:24.224945 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-7bc6307f-b6ba-40f7-968f-5c45aeadb3c6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:16:24.225677 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-7bc6307f-b6ba-40f7-968f-5c45aeadb3c6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:16:24.226282 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-7bc6307f-b6ba-40f7-968f-5c45aeadb3c6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:16:24.253366 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7bc6307f-b6ba-40f7-968f-5c45aeadb3c6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:24.259327 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7bc6307f-b6ba-40f7-968f-5c45aeadb3c6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:24.260638 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7bc6307f-b6ba-40f7-968f-5c45aeadb3c6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:24.261509 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7bc6307f-b6ba-40f7-968f-5c45aeadb3c6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:24.330827 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-7bc6307f-b6ba-40f7-968f-5c45aeadb3c6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Getting quotas for project 4a74724882c84e8f893f5be0f59a9581. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:16:24.360381 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:24.364255 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-7bc6307f-b6ba-40f7-968f-5c45aeadb3c6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Getting quotas for user fff9f1fc84a54b83a7a384965f40c9d9 and project 4a74724882c84e8f893f5be0f59a9581. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:16:24.404313 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=23 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:24.469219 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7bc6307f-b6ba-40f7-968f-5c45aeadb3c6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:16:24.485135 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7bc6307f-b6ba-40f7-968f-5c45aeadb3c6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3155f228-b1ff-487e-837f-85eec68c250a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:16:24.626049 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-023af857-31ac-4974-a8ed-7c4d7a847baf tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:24.650438 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-023af857-31ac-4974-a8ed-7c4d7a847baf tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1321 microversion: 2.1 time: 0.487304 Jun 27 21:16:24.660847 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 22/43] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:24 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1321 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:24.669341 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7bc6307f-b6ba-40f7-968f-5c45aeadb3c6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.906059 Jun 27 21:16:24.676454 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 22/44] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 27 21:16:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 1914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:16:24.700201 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-53b96855-59a4-49b1-a639-72fb8692b94b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:24.703356 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ceede096-54e2-41b1-8c06-088ac1b15805 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:24.704619 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ceede096-54e2-41b1-8c06-088ac1b15805 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:24.704740 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-53b96855-59a4-49b1-a639-72fb8692b94b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:24.714961 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ceede096-54e2-41b1-8c06-088ac1b15805 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:24.724466 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ceede096-54e2-41b1-8c06-088ac1b15805 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:24.724466 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ceede096-54e2-41b1-8c06-088ac1b15805 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:24.724466 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ceede096-54e2-41b1-8c06-088ac1b15805 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:24.731452 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-53b96855-59a4-49b1-a639-72fb8692b94b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:24.735113 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-53b96855-59a4-49b1-a639-72fb8692b94b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:24.736259 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-53b96855-59a4-49b1-a639-72fb8692b94b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:24.739454 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-53b96855-59a4-49b1-a639-72fb8692b94b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:25.134708 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-53b96855-59a4-49b1-a639-72fb8692b94b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:25.159529 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-53b96855-59a4-49b1-a639-72fb8692b94b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1234 microversion: 2.1 time: 0.489036 Jun 27 21:16:25.170833 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 23/45] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:24 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1234 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:25.178220 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d3eb894e-c380-4a54-ac85-dc094d9012c0 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:25.204242 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d3eb894e-c380-4a54-ac85-dc094d9012c0 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:25.617886 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ceede096-54e2-41b1-8c06-088ac1b15805 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:25.642720 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d3eb894e-c380-4a54-ac85-dc094d9012c0 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:25.645437 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=29 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:25.647607 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ceede096-54e2-41b1-8c06-088ac1b15805 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1275 microversion: 2.1 time: 0.964040 Jun 27 21:16:25.648224 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 23/46] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:24 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1275 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:25.656626 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d3eb894e-c380-4a54-ac85-dc094d9012c0 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1239 microversion: 2.1 time: 0.480718 Jun 27 21:16:25.663958 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 24/47] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:25 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1239 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:25.668238 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-16203ba7-3da8-4012-a720-cc9de57063cc tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:25.672185 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-16203ba7-3da8-4012-a720-cc9de57063cc tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:25.685825 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-16203ba7-3da8-4012-a720-cc9de57063cc tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:25.686741 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-16203ba7-3da8-4012-a720-cc9de57063cc tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:25.687920 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-16203ba7-3da8-4012-a720-cc9de57063cc tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:25.688768 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-16203ba7-3da8-4012-a720-cc9de57063cc tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:26.181831 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b2030e80-f11c-4b4f-855b-f01c66167443 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:26.183501 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b2030e80-f11c-4b4f-855b-f01c66167443 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:26.199018 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b2030e80-f11c-4b4f-855b-f01c66167443 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:26.199970 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b2030e80-f11c-4b4f-855b-f01c66167443 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:26.209865 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b2030e80-f11c-4b4f-855b-f01c66167443 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:26.210500 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b2030e80-f11c-4b4f-855b-f01c66167443 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:26.412173 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b2030e80-f11c-4b4f-855b-f01c66167443 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:26.421258 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b2030e80-f11c-4b4f-855b-f01c66167443 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1290 microversion: 2.1 time: 0.245833 Jun 27 21:16:26.421912 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 25/48] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:26 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1290 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:26.498869 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-16203ba7-3da8-4012-a720-cc9de57063cc tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:26.510233 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-16203ba7-3da8-4012-a720-cc9de57063cc tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1321 microversion: 2.1 time: 0.846515 Jun 27 21:16:26.511077 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 24/49] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:25 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1321 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:26.665294 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4b68ae61-413b-4d20-a624-19d439aa099f tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:26.666087 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4b68ae61-413b-4d20-a624-19d439aa099f tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:26.679642 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-76ab519f-2a3c-40dd-a36f-b83bdd9c6e85 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:26.680307 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-76ab519f-2a3c-40dd-a36f-b83bdd9c6e85 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:26.691387 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76ab519f-2a3c-40dd-a36f-b83bdd9c6e85 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:26.696136 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76ab519f-2a3c-40dd-a36f-b83bdd9c6e85 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:26.697143 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4b68ae61-413b-4d20-a624-19d439aa099f tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:26.701174 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4b68ae61-413b-4d20-a624-19d439aa099f tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:26.701528 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76ab519f-2a3c-40dd-a36f-b83bdd9c6e85 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:26.701990 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76ab519f-2a3c-40dd-a36f-b83bdd9c6e85 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:26.703435 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4b68ae61-413b-4d20-a624-19d439aa099f tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:26.703882 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4b68ae61-413b-4d20-a624-19d439aa099f tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:26.877239 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4b68ae61-413b-4d20-a624-19d439aa099f tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:26.891891 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4b68ae61-413b-4d20-a624-19d439aa099f tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1273 microversion: 2.1 time: 0.230798 Jun 27 21:16:26.893264 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 26/50] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:26 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1273 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:26.927601 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-88466c52-702f-4982-a2e5-86ea374062d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-252434122", "imageRef": "3155f228-b1ff-487e-837f-85eec68c250a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "449e2e33-47ed-4bc8-9db3-ee1c9d54d111"}], "security_groups": [{"name": "tempest-securitygroup--591485288"}], "key_name": "tempest-keypair-2107055284", "user_data": "}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:27.077832 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-76ab519f-2a3c-40dd-a36f-b83bdd9c6e85 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:27.086451 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-76ab519f-2a3c-40dd-a36f-b83bdd9c6e85 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1243 microversion: 2.1 time: 0.412860 Jun 27 21:16:27.087504 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 25/51] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:26 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1243 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:27.097640 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.network.neutron [None req-88466c52-702f-4982-a2e5-86ea374062d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] validate_networks() for [('449e2e33-47ed-4bc8-9db3-ee1c9d54d111', None, None, None, None, None)] {{(pid=117891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:16:27.439854 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c30cae80-fa3a-4343-8f0a-77c9fd7c224b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:27.440475 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c30cae80-fa3a-4343-8f0a-77c9fd7c224b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:27.451244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c30cae80-fa3a-4343-8f0a-77c9fd7c224b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:27.451906 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c30cae80-fa3a-4343-8f0a-77c9fd7c224b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:27.452861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c30cae80-fa3a-4343-8f0a-77c9fd7c224b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:27.454179 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c30cae80-fa3a-4343-8f0a-77c9fd7c224b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:27.554445 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c30cae80-fa3a-4343-8f0a-77c9fd7c224b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:27.563197 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c30cae80-fa3a-4343-8f0a-77c9fd7c224b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1298 microversion: 2.1 time: 0.127470 Jun 27 21:16:27.564117 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 26/52] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:27 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1298 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:27.569991 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4cfd66c9-11f0-4c13-bad2-64c165aaac6e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:27.570614 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4cfd66c9-11f0-4c13-bad2-64c165aaac6e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:27.578519 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4cfd66c9-11f0-4c13-bad2-64c165aaac6e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:27.579202 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4cfd66c9-11f0-4c13-bad2-64c165aaac6e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:27.580148 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4cfd66c9-11f0-4c13-bad2-64c165aaac6e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:27.580776 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4cfd66c9-11f0-4c13-bad2-64c165aaac6e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:27.588907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-88466c52-702f-4982-a2e5-86ea374062d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Flavor limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:16:27.589708 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-88466c52-702f-4982-a2e5-86ea374062d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Image limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:16:27.589848 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-88466c52-702f-4982-a2e5-86ea374062d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Flavor pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:16:27.590186 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-88466c52-702f-4982-a2e5-86ea374062d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Image pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:16:27.590650 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-88466c52-702f-4982-a2e5-86ea374062d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:16:27.603092 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-88466c52-702f-4982-a2e5-86ea374062d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:27.603763 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-88466c52-702f-4982-a2e5-86ea374062d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:27.604955 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-88466c52-702f-4982-a2e5-86ea374062d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:27.605614 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-88466c52-702f-4982-a2e5-86ea374062d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:27.628820 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-88466c52-702f-4982-a2e5-86ea374062d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Getting quotas for project 0cdaf724b92644a0ae7fbb71147aef40. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:16:27.635113 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-88466c52-702f-4982-a2e5-86ea374062d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Getting quotas for user ba0127dd69da407ab096773fc9e22530 and project 0cdaf724b92644a0ae7fbb71147aef40. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:16:27.646833 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-88466c52-702f-4982-a2e5-86ea374062d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Going to run 1 instances... {{(pid=117891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:16:27.649263 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-88466c52-702f-4982-a2e5-86ea374062d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3155f228-b1ff-487e-837f-85eec68c250a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:16:27.700053 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-88466c52-702f-4982-a2e5-86ea374062d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.778039 Jun 27 21:16:27.700794 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 27/53] 10.222.0.13 () {62 vars in 1187 bytes} [Mon Jun 27 21:16:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 27 21:16:27.713195 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b89a65dc-2129-4547-aec4-dbd6f9b4eb2f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:27.714736 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b89a65dc-2129-4547-aec4-dbd6f9b4eb2f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:27.732943 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4cfd66c9-11f0-4c13-bad2-64c165aaac6e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:27.744329 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4cfd66c9-11f0-4c13-bad2-64c165aaac6e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1321 microversion: 2.1 time: 0.178785 Jun 27 21:16:27.745829 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 27/54] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:27 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:27.793628 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b89a65dc-2129-4547-aec4-dbd6f9b4eb2f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:27.807426 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b89a65dc-2129-4547-aec4-dbd6f9b4eb2f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:27.809215 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b89a65dc-2129-4547-aec4-dbd6f9b4eb2f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:27.810319 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b89a65dc-2129-4547-aec4-dbd6f9b4eb2f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1281 microversion: 2.20 time: 0.102251 Jun 27 21:16:27.811396 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 28/55] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:27 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1281 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:27.920010 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-92148f97-810c-4679-90b6-9d72bb7d0d4b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:27.920687 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-92148f97-810c-4679-90b6-9d72bb7d0d4b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:27.927023 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-92148f97-810c-4679-90b6-9d72bb7d0d4b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:27.927478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-92148f97-810c-4679-90b6-9d72bb7d0d4b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:27.928239 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-92148f97-810c-4679-90b6-9d72bb7d0d4b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:27.928692 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-92148f97-810c-4679-90b6-9d72bb7d0d4b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:27.995308 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-92148f97-810c-4679-90b6-9d72bb7d0d4b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:28.003699 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-92148f97-810c-4679-90b6-9d72bb7d0d4b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1273 microversion: 2.1 time: 0.087931 Jun 27 21:16:28.004276 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 28/56] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:27 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:28.103726 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5f86a289-c4e4-4e1b-bcd5-bc2c7ed67022 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:28.104306 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-5f86a289-c4e4-4e1b-bcd5-bc2c7ed67022 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:28.110556 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5f86a289-c4e4-4e1b-bcd5-bc2c7ed67022 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:28.110997 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5f86a289-c4e4-4e1b-bcd5-bc2c7ed67022 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:28.111750 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5f86a289-c4e4-4e1b-bcd5-bc2c7ed67022 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:28.112173 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5f86a289-c4e4-4e1b-bcd5-bc2c7ed67022 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:28.172297 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5f86a289-c4e4-4e1b-bcd5-bc2c7ed67022 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:28.179691 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5f86a289-c4e4-4e1b-bcd5-bc2c7ed67022 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1243 microversion: 2.1 time: 0.079937 Jun 27 21:16:28.180266 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 29/57] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:28 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1243 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:28.581517 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bddd7ca1-33ed-4592-bec2-21e2a62b089f tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:28.582134 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bddd7ca1-33ed-4592-bec2-21e2a62b089f tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:28.589229 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bddd7ca1-33ed-4592-bec2-21e2a62b089f tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:28.589703 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bddd7ca1-33ed-4592-bec2-21e2a62b089f tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:28.590467 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bddd7ca1-33ed-4592-bec2-21e2a62b089f tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:28.590904 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bddd7ca1-33ed-4592-bec2-21e2a62b089f tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:28.651605 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bddd7ca1-33ed-4592-bec2-21e2a62b089f tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:28.659302 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bddd7ca1-33ed-4592-bec2-21e2a62b089f tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1298 microversion: 2.1 time: 0.081788 Jun 27 21:16:28.659875 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 29/58] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:28 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1298 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:28.761766 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0eeabfa0-41db-4f00-a315-0088072cc24c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:28.762352 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0eeabfa0-41db-4f00-a315-0088072cc24c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:28.768995 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0eeabfa0-41db-4f00-a315-0088072cc24c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:28.769475 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0eeabfa0-41db-4f00-a315-0088072cc24c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:28.770243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0eeabfa0-41db-4f00-a315-0088072cc24c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:28.770674 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0eeabfa0-41db-4f00-a315-0088072cc24c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:28.834285 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3c9c410f-2698-414b-beb6-657fe9eee2e2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:28.834917 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3c9c410f-2698-414b-beb6-657fe9eee2e2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:28.845282 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c9c410f-2698-414b-beb6-657fe9eee2e2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:28.846161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c9c410f-2698-414b-beb6-657fe9eee2e2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:28.847097 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c9c410f-2698-414b-beb6-657fe9eee2e2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:28.853357 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c9c410f-2698-414b-beb6-657fe9eee2e2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:28.945558 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0eeabfa0-41db-4f00-a315-0088072cc24c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:28.948723 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3c9c410f-2698-414b-beb6-657fe9eee2e2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:28.955809 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0eeabfa0-41db-4f00-a315-0088072cc24c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1321 microversion: 2.1 time: 0.197974 Jun 27 21:16:28.956899 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 30/59] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:28 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:28.959437 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3c9c410f-2698-414b-beb6-657fe9eee2e2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:28.961406 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3c9c410f-2698-414b-beb6-657fe9eee2e2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:28.966360 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3c9c410f-2698-414b-beb6-657fe9eee2e2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1285 microversion: 2.20 time: 0.141596 Jun 27 21:16:28.967188 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 30/60] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:28 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:29.028598 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-07ba290c-2293-4ea2-8f62-16672b782d79 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:29.032045 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-07ba290c-2293-4ea2-8f62-16672b782d79 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:29.038803 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-07ba290c-2293-4ea2-8f62-16672b782d79 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:29.039243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-07ba290c-2293-4ea2-8f62-16672b782d79 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:29.040026 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-07ba290c-2293-4ea2-8f62-16672b782d79 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:29.040909 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-07ba290c-2293-4ea2-8f62-16672b782d79 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:29.110701 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-07ba290c-2293-4ea2-8f62-16672b782d79 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:29.119253 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-07ba290c-2293-4ea2-8f62-16672b782d79 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1273 microversion: 2.1 time: 0.100770 Jun 27 21:16:29.128728 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 31/61] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:29 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:29.196439 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5d7c92a6-79f3-406a-82a2-41c60d53aaad tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:29.197410 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5d7c92a6-79f3-406a-82a2-41c60d53aaad tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:29.204347 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d7c92a6-79f3-406a-82a2-41c60d53aaad tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:29.205136 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d7c92a6-79f3-406a-82a2-41c60d53aaad tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:29.206127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d7c92a6-79f3-406a-82a2-41c60d53aaad tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:29.206846 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d7c92a6-79f3-406a-82a2-41c60d53aaad tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:29.304011 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5d7c92a6-79f3-406a-82a2-41c60d53aaad tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:29.324226 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5d7c92a6-79f3-406a-82a2-41c60d53aaad tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1243 microversion: 2.1 time: 0.131483 Jun 27 21:16:29.341952 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 31/62] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:29 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1243 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:29.677543 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2ac07bcf-d381-4621-81b6-b80c78dc4513 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:29.678394 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2ac07bcf-d381-4621-81b6-b80c78dc4513 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:29.691270 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2ac07bcf-d381-4621-81b6-b80c78dc4513 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:29.694494 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2ac07bcf-d381-4621-81b6-b80c78dc4513 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:29.698479 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2ac07bcf-d381-4621-81b6-b80c78dc4513 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:29.699703 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2ac07bcf-d381-4621-81b6-b80c78dc4513 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:29.877776 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2ac07bcf-d381-4621-81b6-b80c78dc4513 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:29.896127 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2ac07bcf-d381-4621-81b6-b80c78dc4513 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1298 microversion: 2.1 time: 0.220173 Jun 27 21:16:29.896890 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 32/63] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:29 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1298 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:29.974504 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-20cd5e7b-5725-44e8-b6f5-9d54ab5ee61b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:29.975322 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-20cd5e7b-5725-44e8-b6f5-9d54ab5ee61b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:29.987425 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-39d4e403-7b25-4631-8db4-f20c439cbd45 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:29.987628 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-20cd5e7b-5725-44e8-b6f5-9d54ab5ee61b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:29.988045 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-39d4e403-7b25-4631-8db4-f20c439cbd45 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:29.988167 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-20cd5e7b-5725-44e8-b6f5-9d54ab5ee61b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:29.988861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-20cd5e7b-5725-44e8-b6f5-9d54ab5ee61b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:29.989340 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-20cd5e7b-5725-44e8-b6f5-9d54ab5ee61b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:30.004699 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-39d4e403-7b25-4631-8db4-f20c439cbd45 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:30.005154 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-39d4e403-7b25-4631-8db4-f20c439cbd45 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:30.005947 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-39d4e403-7b25-4631-8db4-f20c439cbd45 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:30.010034 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-39d4e403-7b25-4631-8db4-f20c439cbd45 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:30.174835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-39d4e403-7b25-4631-8db4-f20c439cbd45 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:30.192879 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-39d4e403-7b25-4631-8db4-f20c439cbd45 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:30.199814 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-39d4e403-7b25-4631-8db4-f20c439cbd45 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:30.202417 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-39d4e403-7b25-4631-8db4-f20c439cbd45 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1285 microversion: 2.20 time: 0.220583 Jun 27 21:16:30.203594 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:29 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:16:30.210689 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-32cc2e84-6ffa-46ee-9a68-dc05dd84e3b5 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:30.211618 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-32cc2e84-6ffa-46ee-9a68-dc05dd84e3b5 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:30.224314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-32cc2e84-6ffa-46ee-9a68-dc05dd84e3b5 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:30.225046 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-32cc2e84-6ffa-46ee-9a68-dc05dd84e3b5 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:30.225996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-32cc2e84-6ffa-46ee-9a68-dc05dd84e3b5 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:30.226897 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-32cc2e84-6ffa-46ee-9a68-dc05dd84e3b5 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:30.251590 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=100 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:30.307216 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-20cd5e7b-5725-44e8-b6f5-9d54ab5ee61b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:30.318345 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-20cd5e7b-5725-44e8-b6f5-9d54ab5ee61b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1321 microversion: 2.1 time: 0.345708 Jun 27 21:16:30.321995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 32/65] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:29 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:30.354076 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e35b8ab3-0f16-476b-99bd-848cba72e5d6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:30.354076 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e35b8ab3-0f16-476b-99bd-848cba72e5d6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:30.414748 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e35b8ab3-0f16-476b-99bd-848cba72e5d6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:30.416561 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e35b8ab3-0f16-476b-99bd-848cba72e5d6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:30.417976 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e35b8ab3-0f16-476b-99bd-848cba72e5d6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:30.419509 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e35b8ab3-0f16-476b-99bd-848cba72e5d6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:30.980853 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e35b8ab3-0f16-476b-99bd-848cba72e5d6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:30.991573 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e35b8ab3-0f16-476b-99bd-848cba72e5d6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1243 microversion: 2.1 time: 0.643584 Jun 27 21:16:30.998267 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 33/66] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:30 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1243 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:31.005799 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d076e44b-3fd2-4511-be80-97eb36be5ba0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:31.006654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d076e44b-3fd2-4511-be80-97eb36be5ba0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:31.036794 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d076e44b-3fd2-4511-be80-97eb36be5ba0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:31.041991 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d076e44b-3fd2-4511-be80-97eb36be5ba0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:31.042842 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d076e44b-3fd2-4511-be80-97eb36be5ba0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:31.043510 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d076e44b-3fd2-4511-be80-97eb36be5ba0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:31.052668 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:31.053945 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-32cc2e84-6ffa-46ee-9a68-dc05dd84e3b5 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:31.069788 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-32cc2e84-6ffa-46ee-9a68-dc05dd84e3b5 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1315 microversion: 2.1 time: 0.864846 Jun 27 21:16:31.074347 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 34/67] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:30 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1315 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:31.222528 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c1dad631-07ea-4158-953a-5e483333a44b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:31.223557 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c1dad631-07ea-4158-953a-5e483333a44b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:31.236687 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c1dad631-07ea-4158-953a-5e483333a44b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:31.237489 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c1dad631-07ea-4158-953a-5e483333a44b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:31.238453 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c1dad631-07ea-4158-953a-5e483333a44b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:31.239204 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c1dad631-07ea-4158-953a-5e483333a44b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:31.273388 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d076e44b-3fd2-4511-be80-97eb36be5ba0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:31.284418 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d076e44b-3fd2-4511-be80-97eb36be5ba0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1296 microversion: 2.1 time: 0.284728 Jun 27 21:16:31.285865 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 34/68] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:30 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1296 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:31.338841 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8944028a-c7d2-4f42-bd4e-c28cdf704afa tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:31.339473 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8944028a-c7d2-4f42-bd4e-c28cdf704afa tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:31.355304 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8944028a-c7d2-4f42-bd4e-c28cdf704afa tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:31.355727 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8944028a-c7d2-4f42-bd4e-c28cdf704afa tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:31.356510 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8944028a-c7d2-4f42-bd4e-c28cdf704afa tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:31.358842 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c1dad631-07ea-4158-953a-5e483333a44b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:31.362100 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8944028a-c7d2-4f42-bd4e-c28cdf704afa tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:31.373419 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c1dad631-07ea-4158-953a-5e483333a44b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:31.375466 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c1dad631-07ea-4158-953a-5e483333a44b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:31.379715 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c1dad631-07ea-4158-953a-5e483333a44b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1333 microversion: 2.20 time: 0.160410 Jun 27 21:16:31.381905 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 35/69] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:31 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1333 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:16:31.834634 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8944028a-c7d2-4f42-bd4e-c28cdf704afa tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:31.844099 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8944028a-c7d2-4f42-bd4e-c28cdf704afa tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1321 microversion: 2.1 time: 0.511864 Jun 27 21:16:31.853440 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 35/70] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:31 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1321 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:32.015803 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a4c7a942-2def-47a0-b80b-85978219b453 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:32.016696 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a4c7a942-2def-47a0-b80b-85978219b453 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:32.031498 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a4c7a942-2def-47a0-b80b-85978219b453 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:32.032180 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a4c7a942-2def-47a0-b80b-85978219b453 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:32.034375 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a4c7a942-2def-47a0-b80b-85978219b453 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:32.036819 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a4c7a942-2def-47a0-b80b-85978219b453 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:32.102339 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-66b3880d-2198-4c62-8fba-e1f3f5d8f270 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:32.105519 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-66b3880d-2198-4c62-8fba-e1f3f5d8f270 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:32.119815 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66b3880d-2198-4c62-8fba-e1f3f5d8f270 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:32.120392 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66b3880d-2198-4c62-8fba-e1f3f5d8f270 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:32.122576 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66b3880d-2198-4c62-8fba-e1f3f5d8f270 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:32.123540 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66b3880d-2198-4c62-8fba-e1f3f5d8f270 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:32.159243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a4c7a942-2def-47a0-b80b-85978219b453 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:32.174597 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a4c7a942-2def-47a0-b80b-85978219b453 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1291 microversion: 2.1 time: 0.160908 Jun 27 21:16:32.198222 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 36/71] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:32 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1291 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:32.321525 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-88c25afd-43b2-4241-862f-a81e46459d25 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:32.326723 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-88c25afd-43b2-4241-862f-a81e46459d25 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:32.346682 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-88c25afd-43b2-4241-862f-a81e46459d25 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:32.357831 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-88c25afd-43b2-4241-862f-a81e46459d25 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:32.359016 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-88c25afd-43b2-4241-862f-a81e46459d25 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:32.359630 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-88c25afd-43b2-4241-862f-a81e46459d25 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:32.477172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-88c25afd-43b2-4241-862f-a81e46459d25 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:32.486090 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-88c25afd-43b2-4241-862f-a81e46459d25 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1296 microversion: 2.1 time: 0.187660 Jun 27 21:16:32.497719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 37/72] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:32 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1296 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:32.503893 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5e859cd0-ddd9-4405-8c45-3b75747e0b25 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:32.504751 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-5e859cd0-ddd9-4405-8c45-3b75747e0b25 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:32.511726 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5e859cd0-ddd9-4405-8c45-3b75747e0b25 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:32.512431 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5e859cd0-ddd9-4405-8c45-3b75747e0b25 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:32.513415 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5e859cd0-ddd9-4405-8c45-3b75747e0b25 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:32.513992 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5e859cd0-ddd9-4405-8c45-3b75747e0b25 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:32.699401 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5e859cd0-ddd9-4405-8c45-3b75747e0b25 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:32.710417 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5e859cd0-ddd9-4405-8c45-3b75747e0b25 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:32.712507 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5e859cd0-ddd9-4405-8c45-3b75747e0b25 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:32.715445 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5e859cd0-ddd9-4405-8c45-3b75747e0b25 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1333 microversion: 2.20 time: 0.216362 Jun 27 21:16:32.716601 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 38/73] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:32 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1333 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:32.746067 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-66b3880d-2198-4c62-8fba-e1f3f5d8f270 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:32.760785 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-66b3880d-2198-4c62-8fba-e1f3f5d8f270 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1315 microversion: 2.1 time: 0.670200 Jun 27 21:16:32.761703 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 36/74] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:32 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1315 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:32.854535 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-4f1a0aec-0036-4e61-9fae-3e2ecca49da7 req-38161a87-9b37-42ce-b15a-b2401099f5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfecef68-0f46-4744-8dc0-d721f692710b", "tag": "baa095fe-f218-45c8-b731-2f6078fc2222"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:32.862103 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-861d7ba7-e3ee-42c1-8b57-a6506e49c0ca tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:32.863000 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-861d7ba7-e3ee-42c1-8b57-a6506e49c0ca tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:32.869826 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-4f1a0aec-0036-4e61-9fae-3e2ecca49da7 req-38161a87-9b37-42ce-b15a-b2401099f5a8 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:32.870390 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-4f1a0aec-0036-4e61-9fae-3e2ecca49da7 req-38161a87-9b37-42ce-b15a-b2401099f5a8 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:32.874839 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-861d7ba7-e3ee-42c1-8b57-a6506e49c0ca tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:32.875289 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-861d7ba7-e3ee-42c1-8b57-a6506e49c0ca tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:32.876082 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-861d7ba7-e3ee-42c1-8b57-a6506e49c0ca tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:32.876519 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-861d7ba7-e3ee-42c1-8b57-a6506e49c0ca tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:32.902700 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-4f1a0aec-0036-4e61-9fae-3e2ecca49da7 req-38161a87-9b37-42ce-b15a-b2401099f5a8 service nova] Creating event network-changed:baa095fe-f218-45c8-b731-2f6078fc2222 for instance cfecef68-0f46-4744-8dc0-d721f692710b on hv-cinder-84773 Jun 27 21:16:32.912390 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-4f1a0aec-0036-4e61-9fae-3e2ecca49da7 req-38161a87-9b37-42ce-b15a-b2401099f5a8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061944 Jun 27 21:16:32.914401 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 39/75] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:33.116856 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-861d7ba7-e3ee-42c1-8b57-a6506e49c0ca tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:33.126529 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-861d7ba7-e3ee-42c1-8b57-a6506e49c0ca tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1321 microversion: 2.1 time: 0.268620 Jun 27 21:16:33.127723 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 37/76] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:32 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:33.198999 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c0bf2c9a-fd5a-4bc7-890a-d265914a6b83 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:33.200496 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c0bf2c9a-fd5a-4bc7-890a-d265914a6b83 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:33.209068 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c0bf2c9a-fd5a-4bc7-890a-d265914a6b83 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:33.209981 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c0bf2c9a-fd5a-4bc7-890a-d265914a6b83 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:33.211192 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c0bf2c9a-fd5a-4bc7-890a-d265914a6b83 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:33.211709 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c0bf2c9a-fd5a-4bc7-890a-d265914a6b83 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:33.283401 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c0bf2c9a-fd5a-4bc7-890a-d265914a6b83 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:33.293145 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c0bf2c9a-fd5a-4bc7-890a-d265914a6b83 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1291 microversion: 2.1 time: 0.099876 Jun 27 21:16:33.293724 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 40/77] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:33 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1291 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:33.504558 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-320f16f9-75d1-42a2-a650-a03372b786a7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:33.505479 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-320f16f9-75d1-42a2-a650-a03372b786a7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:33.513583 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-320f16f9-75d1-42a2-a650-a03372b786a7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:33.514202 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-320f16f9-75d1-42a2-a650-a03372b786a7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:33.515056 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-320f16f9-75d1-42a2-a650-a03372b786a7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:33.515629 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-320f16f9-75d1-42a2-a650-a03372b786a7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:33.587495 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-320f16f9-75d1-42a2-a650-a03372b786a7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:33.597250 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-320f16f9-75d1-42a2-a650-a03372b786a7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1296 microversion: 2.1 time: 0.097199 Jun 27 21:16:33.598410 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 38/78] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:33 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1296 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:33.734437 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e20d89fb-6b5e-4fa1-b7a8-3ac500421b75 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:33.735162 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e20d89fb-6b5e-4fa1-b7a8-3ac500421b75 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:33.745962 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e20d89fb-6b5e-4fa1-b7a8-3ac500421b75 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:33.746649 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e20d89fb-6b5e-4fa1-b7a8-3ac500421b75 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:33.747595 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e20d89fb-6b5e-4fa1-b7a8-3ac500421b75 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:33.748631 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e20d89fb-6b5e-4fa1-b7a8-3ac500421b75 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:33.782994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5c2657fd-176b-426c-9e29-d1ede35cdac1 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:33.783988 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5c2657fd-176b-426c-9e29-d1ede35cdac1 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:33.791922 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5c2657fd-176b-426c-9e29-d1ede35cdac1 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:33.792349 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5c2657fd-176b-426c-9e29-d1ede35cdac1 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:33.793469 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5c2657fd-176b-426c-9e29-d1ede35cdac1 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:33.793944 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5c2657fd-176b-426c-9e29-d1ede35cdac1 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:33.821125 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e20d89fb-6b5e-4fa1-b7a8-3ac500421b75 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:33.832090 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e20d89fb-6b5e-4fa1-b7a8-3ac500421b75 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:33.833749 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e20d89fb-6b5e-4fa1-b7a8-3ac500421b75 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:33.835034 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e20d89fb-6b5e-4fa1-b7a8-3ac500421b75 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1333 microversion: 2.20 time: 0.104725 Jun 27 21:16:33.836238 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 41/79] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:33 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1333 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:34.119714 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5c2657fd-176b-426c-9e29-d1ede35cdac1 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:34.129574 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5c2657fd-176b-426c-9e29-d1ede35cdac1 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1315 microversion: 2.1 time: 0.349456 Jun 27 21:16:34.130236 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 39/80] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:33 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:34.145678 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c2b2abfc-9524-4a4f-bcb1-8d839bda1577 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:34.146554 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c2b2abfc-9524-4a4f-bcb1-8d839bda1577 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:34.153272 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c2b2abfc-9524-4a4f-bcb1-8d839bda1577 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:34.153712 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c2b2abfc-9524-4a4f-bcb1-8d839bda1577 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:34.154658 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c2b2abfc-9524-4a4f-bcb1-8d839bda1577 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:34.155233 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c2b2abfc-9524-4a4f-bcb1-8d839bda1577 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:34.308136 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c2b2abfc-9524-4a4f-bcb1-8d839bda1577 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:34.314350 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3996597c-9932-46a7-a2ab-4a1c17ebc9e4 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:34.315161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3996597c-9932-46a7-a2ab-4a1c17ebc9e4 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:34.315389 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c2b2abfc-9524-4a4f-bcb1-8d839bda1577 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1321 microversion: 2.1 time: 0.173223 Jun 27 21:16:34.316525 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 42/81] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:34 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:34.317177 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:34.322952 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3996597c-9932-46a7-a2ab-4a1c17ebc9e4 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:34.323393 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3996597c-9932-46a7-a2ab-4a1c17ebc9e4 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:34.324154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3996597c-9932-46a7-a2ab-4a1c17ebc9e4 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:34.324726 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3996597c-9932-46a7-a2ab-4a1c17ebc9e4 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:34.396795 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3996597c-9932-46a7-a2ab-4a1c17ebc9e4 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:34.406724 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3996597c-9932-46a7-a2ab-4a1c17ebc9e4 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1291 microversion: 2.1 time: 0.096952 Jun 27 21:16:34.407491 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 40/82] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:34 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1291 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:34.614772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f7f82e6c-89ab-49e5-a3db-8d74d6c59c6b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:34.615629 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f7f82e6c-89ab-49e5-a3db-8d74d6c59c6b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:34.622776 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f7f82e6c-89ab-49e5-a3db-8d74d6c59c6b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:34.623366 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f7f82e6c-89ab-49e5-a3db-8d74d6c59c6b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:34.624337 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f7f82e6c-89ab-49e5-a3db-8d74d6c59c6b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:34.624778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f7f82e6c-89ab-49e5-a3db-8d74d6c59c6b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:34.717394 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f7f82e6c-89ab-49e5-a3db-8d74d6c59c6b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:34.726020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f7f82e6c-89ab-49e5-a3db-8d74d6c59c6b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1296 microversion: 2.1 time: 0.115124 Jun 27 21:16:34.735472 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 43/83] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:34 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1296 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:34.855318 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-62365a95-7eb8-43b2-89e2-9958b0e96b00 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:34.856213 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-62365a95-7eb8-43b2-89e2-9958b0e96b00 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:34.858118 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:34.863451 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62365a95-7eb8-43b2-89e2-9958b0e96b00 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:34.864072 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62365a95-7eb8-43b2-89e2-9958b0e96b00 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:34.865026 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62365a95-7eb8-43b2-89e2-9958b0e96b00 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:34.865604 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62365a95-7eb8-43b2-89e2-9958b0e96b00 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:34.938774 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-62365a95-7eb8-43b2-89e2-9958b0e96b00 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:34.949435 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-62365a95-7eb8-43b2-89e2-9958b0e96b00 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:34.950945 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-62365a95-7eb8-43b2-89e2-9958b0e96b00 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:34.952092 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-62365a95-7eb8-43b2-89e2-9958b0e96b00 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1333 microversion: 2.20 time: 0.101355 Jun 27 21:16:34.952819 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 41/84] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:34 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1333 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:35.147130 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4cafcfad-dd69-4ab7-98e3-a88fac18bdb4 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:35.147733 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4cafcfad-dd69-4ab7-98e3-a88fac18bdb4 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:35.159704 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4cafcfad-dd69-4ab7-98e3-a88fac18bdb4 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:35.160018 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4cafcfad-dd69-4ab7-98e3-a88fac18bdb4 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:35.161456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4cafcfad-dd69-4ab7-98e3-a88fac18bdb4 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:35.162011 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4cafcfad-dd69-4ab7-98e3-a88fac18bdb4 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:35.323372 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4cafcfad-dd69-4ab7-98e3-a88fac18bdb4 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:35.333695 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4cafcfad-dd69-4ab7-98e3-a88fac18bdb4 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1315 microversion: 2.1 time: 0.190568 Jun 27 21:16:35.334986 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 44/85] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:35 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:35.339615 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1005a669-c7bb-4cfc-8d07-cf2a26e66f4a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:35.340368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1005a669-c7bb-4cfc-8d07-cf2a26e66f4a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:35.347152 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1005a669-c7bb-4cfc-8d07-cf2a26e66f4a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:35.347674 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1005a669-c7bb-4cfc-8d07-cf2a26e66f4a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:35.348713 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1005a669-c7bb-4cfc-8d07-cf2a26e66f4a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:35.349320 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1005a669-c7bb-4cfc-8d07-cf2a26e66f4a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:35.423956 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7460b30f-2728-4c9f-a393-9734a28194bf tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:35.425063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7460b30f-2728-4c9f-a393-9734a28194bf tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:35.432213 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7460b30f-2728-4c9f-a393-9734a28194bf tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:35.432660 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7460b30f-2728-4c9f-a393-9734a28194bf tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:35.433603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7460b30f-2728-4c9f-a393-9734a28194bf tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:35.434197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7460b30f-2728-4c9f-a393-9734a28194bf tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:35.511011 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7460b30f-2728-4c9f-a393-9734a28194bf tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:35.521054 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7460b30f-2728-4c9f-a393-9734a28194bf tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1291 microversion: 2.1 time: 0.101017 Jun 27 21:16:35.535490 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 45/86] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:35 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1291 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:35.623747 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1005a669-c7bb-4cfc-8d07-cf2a26e66f4a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:35.632366 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1005a669-c7bb-4cfc-8d07-cf2a26e66f4a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1321 microversion: 2.1 time: 0.303224 Jun 27 21:16:35.642329 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 42/87] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:35 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:35.751330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-53cd79e5-3d84-4e69-857f-1a6bb3e57368 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:35.753763 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-53cd79e5-3d84-4e69-857f-1a6bb3e57368 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:35.769782 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-53cd79e5-3d84-4e69-857f-1a6bb3e57368 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:35.770839 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-53cd79e5-3d84-4e69-857f-1a6bb3e57368 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:35.772278 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-53cd79e5-3d84-4e69-857f-1a6bb3e57368 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:35.773234 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-53cd79e5-3d84-4e69-857f-1a6bb3e57368 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:35.972300 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a1d0b4a0-ae9f-47a3-88fe-a02328a50a81 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:35.973044 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a1d0b4a0-ae9f-47a3-88fe-a02328a50a81 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:35.980248 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a1d0b4a0-ae9f-47a3-88fe-a02328a50a81 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:35.981606 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a1d0b4a0-ae9f-47a3-88fe-a02328a50a81 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:35.983863 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a1d0b4a0-ae9f-47a3-88fe-a02328a50a81 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:35.984705 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a1d0b4a0-ae9f-47a3-88fe-a02328a50a81 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:35.997629 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-53cd79e5-3d84-4e69-857f-1a6bb3e57368 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:36.016294 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-53cd79e5-3d84-4e69-857f-1a6bb3e57368 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1296 microversion: 2.1 time: 0.274341 Jun 27 21:16:36.019015 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 46/88] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:35 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1296 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:36.265514 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a1d0b4a0-ae9f-47a3-88fe-a02328a50a81 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:36.288877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a1d0b4a0-ae9f-47a3-88fe-a02328a50a81 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:36.291992 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a1d0b4a0-ae9f-47a3-88fe-a02328a50a81 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:36.295072 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a1d0b4a0-ae9f-47a3-88fe-a02328a50a81 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1341 microversion: 2.20 time: 0.326854 Jun 27 21:16:36.300263 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 43/89] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:35 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1341 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:16:36.352474 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-45065acb-d5dd-42a1-816a-296361daf803 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:36.353238 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-45065acb-d5dd-42a1-816a-296361daf803 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:36.360617 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-45065acb-d5dd-42a1-816a-296361daf803 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:36.361898 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-45065acb-d5dd-42a1-816a-296361daf803 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:36.362777 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-45065acb-d5dd-42a1-816a-296361daf803 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:36.363216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-45065acb-d5dd-42a1-816a-296361daf803 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:36.543508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2b9675df-351b-486d-874d-eec500ae2ccb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:36.545216 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2b9675df-351b-486d-874d-eec500ae2ccb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:36.553527 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b9675df-351b-486d-874d-eec500ae2ccb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:36.554323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b9675df-351b-486d-874d-eec500ae2ccb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:36.555210 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b9675df-351b-486d-874d-eec500ae2ccb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:36.556044 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b9675df-351b-486d-874d-eec500ae2ccb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:36.633262 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2b9675df-351b-486d-874d-eec500ae2ccb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:36.643140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2b9675df-351b-486d-874d-eec500ae2ccb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1309 microversion: 2.1 time: 0.104469 Jun 27 21:16:36.643736 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 44/90] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:36 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:36.660367 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f33f6414-a175-462f-b019-863feb2670bf tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:36.661031 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f33f6414-a175-462f-b019-863feb2670bf tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:36.669509 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f33f6414-a175-462f-b019-863feb2670bf tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:36.669955 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f33f6414-a175-462f-b019-863feb2670bf tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:36.670738 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f33f6414-a175-462f-b019-863feb2670bf tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:36.671155 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f33f6414-a175-462f-b019-863feb2670bf tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:36.694396 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-45065acb-d5dd-42a1-816a-296361daf803 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:36.706510 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-45065acb-d5dd-42a1-816a-296361daf803 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1315 microversion: 2.1 time: 0.358175 Jun 27 21:16:36.720243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 47/91] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:36 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:36.870842 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f33f6414-a175-462f-b019-863feb2670bf tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:36.882841 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f33f6414-a175-462f-b019-863feb2670bf tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1321 microversion: 2.1 time: 0.233977 Jun 27 21:16:36.890918 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 45/92] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:36 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:37.035935 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1747e41e-4fe0-44b7-bcb0-e4715d159452 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:37.036730 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1747e41e-4fe0-44b7-bcb0-e4715d159452 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:37.045988 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1747e41e-4fe0-44b7-bcb0-e4715d159452 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:37.046602 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1747e41e-4fe0-44b7-bcb0-e4715d159452 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:37.047533 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1747e41e-4fe0-44b7-bcb0-e4715d159452 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:37.047966 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1747e41e-4fe0-44b7-bcb0-e4715d159452 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:37.208951 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1747e41e-4fe0-44b7-bcb0-e4715d159452 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:37.219209 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1747e41e-4fe0-44b7-bcb0-e4715d159452 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1364 microversion: 2.1 time: 0.187833 Jun 27 21:16:37.220486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 48/93] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:37 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:37.319465 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5ea9461a-9960-4fcd-84a6-9bb2ed090f42 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:37.319989 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5ea9461a-9960-4fcd-84a6-9bb2ed090f42 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:37.328656 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ea9461a-9960-4fcd-84a6-9bb2ed090f42 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:37.329132 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ea9461a-9960-4fcd-84a6-9bb2ed090f42 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:37.329886 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ea9461a-9960-4fcd-84a6-9bb2ed090f42 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:37.330331 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ea9461a-9960-4fcd-84a6-9bb2ed090f42 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:37.451290 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5ea9461a-9960-4fcd-84a6-9bb2ed090f42 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:37.479265 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5ea9461a-9960-4fcd-84a6-9bb2ed090f42 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:37.480879 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5ea9461a-9960-4fcd-84a6-9bb2ed090f42 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:37.482102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5ea9461a-9960-4fcd-84a6-9bb2ed090f42 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1339 microversion: 2.20 time: 0.166794 Jun 27 21:16:37.485461 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 46/94] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:37 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1339 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:37.658166 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=6 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:37.663850 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-763cc73c-924a-4ba3-9661-1d9232d2a9e1 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:37.664831 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-763cc73c-924a-4ba3-9661-1d9232d2a9e1 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:37.676422 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-763cc73c-924a-4ba3-9661-1d9232d2a9e1 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:37.680018 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-763cc73c-924a-4ba3-9661-1d9232d2a9e1 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:37.682867 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-763cc73c-924a-4ba3-9661-1d9232d2a9e1 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:37.685101 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-763cc73c-924a-4ba3-9661-1d9232d2a9e1 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:37.730576 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2fb24eca-5b13-4b88-b804-5d32aa0266e0 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:37.733495 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2fb24eca-5b13-4b88-b804-5d32aa0266e0 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:37.748766 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2fb24eca-5b13-4b88-b804-5d32aa0266e0 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:37.757413 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2fb24eca-5b13-4b88-b804-5d32aa0266e0 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:37.761726 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2fb24eca-5b13-4b88-b804-5d32aa0266e0 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:37.762303 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2fb24eca-5b13-4b88-b804-5d32aa0266e0 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:37.798153 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=9 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:37.841126 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-763cc73c-924a-4ba3-9661-1d9232d2a9e1 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:37.851990 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-763cc73c-924a-4ba3-9661-1d9232d2a9e1 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1297 microversion: 2.1 time: 0.192457 Jun 27 21:16:37.877127 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 49/95] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:37 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1297 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:37.897770 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-cac7884c-a876-4e4a-bb8b-149869330548 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:37.898844 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-cac7884c-a876-4e4a-bb8b-149869330548 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:37.925913 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cac7884c-a876-4e4a-bb8b-149869330548 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:37.926368 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cac7884c-a876-4e4a-bb8b-149869330548 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:37.927149 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cac7884c-a876-4e4a-bb8b-149869330548 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:37.927573 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cac7884c-a876-4e4a-bb8b-149869330548 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:38.017189 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2fb24eca-5b13-4b88-b804-5d32aa0266e0 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:38.027923 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2fb24eca-5b13-4b88-b804-5d32aa0266e0 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1315 microversion: 2.1 time: 0.303849 Jun 27 21:16:38.029042 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 47/96] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:37 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:38.240178 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-af53b0b0-90bd-4a8d-b7b2-f23b4b1f472e tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:38.240847 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-af53b0b0-90bd-4a8d-b7b2-f23b4b1f472e tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:38.266964 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af53b0b0-90bd-4a8d-b7b2-f23b4b1f472e tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:38.269282 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af53b0b0-90bd-4a8d-b7b2-f23b4b1f472e tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:38.270051 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af53b0b0-90bd-4a8d-b7b2-f23b4b1f472e tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:38.270495 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af53b0b0-90bd-4a8d-b7b2-f23b4b1f472e tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:38.302393 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-cac7884c-a876-4e4a-bb8b-149869330548 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:38.313351 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-cac7884c-a876-4e4a-bb8b-149869330548 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1321 microversion: 2.1 time: 0.419770 Jun 27 21:16:38.314139 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 50/97] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:37 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1321 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:38.500701 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e073d566-743a-44a2-9ce9-8a8b1ae003f3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:38.501632 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e073d566-743a-44a2-9ce9-8a8b1ae003f3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:38.510819 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e073d566-743a-44a2-9ce9-8a8b1ae003f3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:38.511251 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e073d566-743a-44a2-9ce9-8a8b1ae003f3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:38.512044 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e073d566-743a-44a2-9ce9-8a8b1ae003f3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:38.512461 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e073d566-743a-44a2-9ce9-8a8b1ae003f3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:38.698770 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e073d566-743a-44a2-9ce9-8a8b1ae003f3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:38.709948 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=100 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:38.717946 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e073d566-743a-44a2-9ce9-8a8b1ae003f3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:38.720019 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e073d566-743a-44a2-9ce9-8a8b1ae003f3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:38.721587 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e073d566-743a-44a2-9ce9-8a8b1ae003f3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1339 microversion: 2.20 time: 0.225637 Jun 27 21:16:38.731114 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 51/98] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:38 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1339 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:16:38.867620 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-0144a8d2-738c-4929-bbcf-9ebfa3d61f37 req-1cf7feab-b8d3-40ce-b0ad-4e9e4573959a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "977f8cd5-d96e-4a13-b043-405e5c4325f1", "tag": "f88b5f5e-d7cd-4400-8ce9-9cede29542e2"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:38.878554 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-0144a8d2-738c-4929-bbcf-9ebfa3d61f37 req-1cf7feab-b8d3-40ce-b0ad-4e9e4573959a service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:38.885735 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-0144a8d2-738c-4929-bbcf-9ebfa3d61f37 req-1cf7feab-b8d3-40ce-b0ad-4e9e4573959a service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:38.921542 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-0144a8d2-738c-4929-bbcf-9ebfa3d61f37 req-1cf7feab-b8d3-40ce-b0ad-4e9e4573959a service nova] Creating event network-changed:f88b5f5e-d7cd-4400-8ce9-9cede29542e2 for instance 977f8cd5-d96e-4a13-b043-405e5c4325f1 on hv-cinder-84773 Jun 27 21:16:38.941338 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-0144a8d2-738c-4929-bbcf-9ebfa3d61f37 req-1cf7feab-b8d3-40ce-b0ad-4e9e4573959a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077174 Jun 27 21:16:38.941959 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 52/99] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:16:38.948098 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7eafd348-cfec-4a6f-a847-aebd1cff2c22 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:38.953121 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7eafd348-cfec-4a6f-a847-aebd1cff2c22 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:38.978960 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7eafd348-cfec-4a6f-a847-aebd1cff2c22 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:38.979692 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7eafd348-cfec-4a6f-a847-aebd1cff2c22 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:38.983652 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7eafd348-cfec-4a6f-a847-aebd1cff2c22 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:38.984322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7eafd348-cfec-4a6f-a847-aebd1cff2c22 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:39.144098 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7eafd348-cfec-4a6f-a847-aebd1cff2c22 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:39.155606 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7eafd348-cfec-4a6f-a847-aebd1cff2c22 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1297 microversion: 2.1 time: 0.212141 Jun 27 21:16:39.159264 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 53/100] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:38 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1297 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:39.175482 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-69e7b20d-cb39-4c86-a5fd-ff0584ce7910 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:39.176321 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-69e7b20d-cb39-4c86-a5fd-ff0584ce7910 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:39.200126 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-69e7b20d-cb39-4c86-a5fd-ff0584ce7910 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:39.204643 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-69e7b20d-cb39-4c86-a5fd-ff0584ce7910 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:39.205863 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-69e7b20d-cb39-4c86-a5fd-ff0584ce7910 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:39.206397 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-69e7b20d-cb39-4c86-a5fd-ff0584ce7910 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:39.532025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-af53b0b0-90bd-4a8d-b7b2-f23b4b1f472e tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:39.544358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-af53b0b0-90bd-4a8d-b7b2-f23b4b1f472e tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1364 microversion: 2.1 time: 1.310855 Jun 27 21:16:39.548773 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 48/101] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:38 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1364 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:39.562809 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3642766c-f627-455a-b30b-8c91d0573c0d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:39.563971 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3642766c-f627-455a-b30b-8c91d0573c0d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:39.578881 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3642766c-f627-455a-b30b-8c91d0573c0d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:39.582125 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3642766c-f627-455a-b30b-8c91d0573c0d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:39.587321 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3642766c-f627-455a-b30b-8c91d0573c0d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:39.588062 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3642766c-f627-455a-b30b-8c91d0573c0d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:40.004119 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-69e7b20d-cb39-4c86-a5fd-ff0584ce7910 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:40.013262 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-69e7b20d-cb39-4c86-a5fd-ff0584ce7910 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1315 microversion: 2.1 time: 0.852483 Jun 27 21:16:40.014467 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 54/102] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:39 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1315 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:40.027165 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-640a70fa-5e7a-4307-b592-b32994572c82 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:40.029568 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-640a70fa-5e7a-4307-b592-b32994572c82 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:40.035950 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:40.051345 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-640a70fa-5e7a-4307-b592-b32994572c82 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:40.052453 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-640a70fa-5e7a-4307-b592-b32994572c82 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:40.054876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-640a70fa-5e7a-4307-b592-b32994572c82 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:40.055566 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-640a70fa-5e7a-4307-b592-b32994572c82 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:40.180569 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-640a70fa-5e7a-4307-b592-b32994572c82 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:40.200378 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-640a70fa-5e7a-4307-b592-b32994572c82 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:40.205434 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-640a70fa-5e7a-4307-b592-b32994572c82 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:40.208330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-640a70fa-5e7a-4307-b592-b32994572c82 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1339 microversion: 2.20 time: 0.191435 Jun 27 21:16:40.209241 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 55/103] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:40 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1339 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:40.216873 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-61198361-c75b-44c2-b90b-c3d70b549d94 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:40.220806 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-61198361-c75b-44c2-b90b-c3d70b549d94 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:40.228322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-61198361-c75b-44c2-b90b-c3d70b549d94 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:40.228794 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-61198361-c75b-44c2-b90b-c3d70b549d94 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:40.230865 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-61198361-c75b-44c2-b90b-c3d70b549d94 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:40.231483 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-61198361-c75b-44c2-b90b-c3d70b549d94 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:40.322408 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3642766c-f627-455a-b30b-8c91d0573c0d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:40.333968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3642766c-f627-455a-b30b-8c91d0573c0d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1321 microversion: 2.1 time: 0.783169 Jun 27 21:16:40.346452 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 49/104] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:39 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1321 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:40.565518 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3afc031a-3047-451d-aee5-d17f812634aa tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:40.566410 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3afc031a-3047-451d-aee5-d17f812634aa tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:40.579918 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3afc031a-3047-451d-aee5-d17f812634aa tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:40.581049 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3afc031a-3047-451d-aee5-d17f812634aa tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:40.582722 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3afc031a-3047-451d-aee5-d17f812634aa tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:40.587571 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3afc031a-3047-451d-aee5-d17f812634aa tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:40.795344 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-61198361-c75b-44c2-b90b-c3d70b549d94 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:40.805043 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-61198361-c75b-44c2-b90b-c3d70b549d94 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1365 microversion: 2.1 time: 0.594383 Jun 27 21:16:40.808596 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 56/105] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:40 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1365 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:41.038282 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-89a5e53f-ac89-401e-8c61-38d0ee767281 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:41.038961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-89a5e53f-ac89-401e-8c61-38d0ee767281 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:41.051761 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-89a5e53f-ac89-401e-8c61-38d0ee767281 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:41.052211 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-89a5e53f-ac89-401e-8c61-38d0ee767281 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:41.055403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-89a5e53f-ac89-401e-8c61-38d0ee767281 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:41.056282 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-89a5e53f-ac89-401e-8c61-38d0ee767281 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:41.366760 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-89a5e53f-ac89-401e-8c61-38d0ee767281 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:41.377989 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3afc031a-3047-451d-aee5-d17f812634aa tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:41.378273 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-89a5e53f-ac89-401e-8c61-38d0ee767281 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1315 microversion: 2.1 time: 0.346368 Jun 27 21:16:41.388087 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 57/106] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:41 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:41.393918 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:41.399874 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3afc031a-3047-451d-aee5-d17f812634aa tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1364 microversion: 2.1 time: 0.840029 Jun 27 21:16:41.401286 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-64e50003-7331-4515-be29-fe2d68acbb8c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:41.402119 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-64e50003-7331-4515-be29-fe2d68acbb8c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:41.403276 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 50/107] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:40 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1364 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:41.411788 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-64e50003-7331-4515-be29-fe2d68acbb8c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:41.412570 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-64e50003-7331-4515-be29-fe2d68acbb8c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:41.413575 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-64e50003-7331-4515-be29-fe2d68acbb8c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:41.414155 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-64e50003-7331-4515-be29-fe2d68acbb8c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:41.419892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4b21c4a1-0f59-4ee4-b90c-d045d1716563 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:41.420505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4b21c4a1-0f59-4ee4-b90c-d045d1716563 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:41.438192 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b21c4a1-0f59-4ee4-b90c-d045d1716563 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:41.439179 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b21c4a1-0f59-4ee4-b90c-d045d1716563 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:41.440607 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b21c4a1-0f59-4ee4-b90c-d045d1716563 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:41.442383 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b21c4a1-0f59-4ee4-b90c-d045d1716563 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:41.891883 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-64e50003-7331-4515-be29-fe2d68acbb8c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:41.900763 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-64e50003-7331-4515-be29-fe2d68acbb8c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:41.902452 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-64e50003-7331-4515-be29-fe2d68acbb8c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:41.904121 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-64e50003-7331-4515-be29-fe2d68acbb8c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1406 microversion: 2.20 time: 0.514061 Jun 27 21:16:41.905353 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 58/108] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:41 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1406 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:41.917172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1e61ab69-db77-441f-94fe-b85287ee28cb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:41.918252 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1e61ab69-db77-441f-94fe-b85287ee28cb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:41.926094 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1e61ab69-db77-441f-94fe-b85287ee28cb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:41.926589 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1e61ab69-db77-441f-94fe-b85287ee28cb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:41.927364 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1e61ab69-db77-441f-94fe-b85287ee28cb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:41.927938 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1e61ab69-db77-441f-94fe-b85287ee28cb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:42.285754 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1e61ab69-db77-441f-94fe-b85287ee28cb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:42.295307 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1e61ab69-db77-441f-94fe-b85287ee28cb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1365 microversion: 2.1 time: 0.388545 Jun 27 21:16:42.296004 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 59/109] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:41 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1365 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:42.300898 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-2e6b9f92-5f62-4207-bcac-ccdfbe4feae6 req-ed3a0054-1c24-4598-84c9-6f3dcc107f20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2a76ab5-ca81-472e-8d89-69e63b684ae3", "tag": "6de54808-7215-48a3-8344-ee5680120151"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:42.312885 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-2e6b9f92-5f62-4207-bcac-ccdfbe4feae6 req-ed3a0054-1c24-4598-84c9-6f3dcc107f20 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:42.313688 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-2e6b9f92-5f62-4207-bcac-ccdfbe4feae6 req-ed3a0054-1c24-4598-84c9-6f3dcc107f20 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:42.320249 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4b21c4a1-0f59-4ee4-b90c-d045d1716563 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:42.328895 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4b21c4a1-0f59-4ee4-b90c-d045d1716563 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1321 microversion: 2.1 time: 0.924531 Jun 27 21:16:42.329811 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 51/110] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:41 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1321 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:42.344712 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-2e6b9f92-5f62-4207-bcac-ccdfbe4feae6 req-ed3a0054-1c24-4598-84c9-6f3dcc107f20 service nova] Creating event network-changed:6de54808-7215-48a3-8344-ee5680120151 for instance b2a76ab5-ca81-472e-8d89-69e63b684ae3 on hv-cinder-84773 Jun 27 21:16:42.358351 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-2e6b9f92-5f62-4207-bcac-ccdfbe4feae6 req-ed3a0054-1c24-4598-84c9-6f3dcc107f20 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060041 Jun 27 21:16:42.360333 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 60/111] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:42.398669 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-53552a76-534a-436b-8157-da0b363e9c59 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:42.399333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-53552a76-534a-436b-8157-da0b363e9c59 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:42.408030 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53552a76-534a-436b-8157-da0b363e9c59 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:42.408661 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53552a76-534a-436b-8157-da0b363e9c59 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:42.410534 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53552a76-534a-436b-8157-da0b363e9c59 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:42.411150 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53552a76-534a-436b-8157-da0b363e9c59 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:42.423532 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4866f59c-df3b-4690-b2bb-04d2308a2800 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:42.425677 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4866f59c-df3b-4690-b2bb-04d2308a2800 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:42.444448 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4866f59c-df3b-4690-b2bb-04d2308a2800 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:42.445042 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4866f59c-df3b-4690-b2bb-04d2308a2800 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:42.453147 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4866f59c-df3b-4690-b2bb-04d2308a2800 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:42.453895 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4866f59c-df3b-4690-b2bb-04d2308a2800 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:42.632390 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4866f59c-df3b-4690-b2bb-04d2308a2800 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:42.642438 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4866f59c-df3b-4690-b2bb-04d2308a2800 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1364 microversion: 2.1 time: 0.226594 Jun 27 21:16:42.643655 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 61/112] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:42 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:42.751260 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-53552a76-534a-436b-8157-da0b363e9c59 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:42.772624 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-53552a76-534a-436b-8157-da0b363e9c59 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1315 microversion: 2.1 time: 0.379975 Jun 27 21:16:42.773810 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 52/113] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:42 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:42.924505 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3093b34a-e403-4437-81b2-ec2b402cd8f1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:42.925166 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3093b34a-e403-4437-81b2-ec2b402cd8f1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:42.936357 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3093b34a-e403-4437-81b2-ec2b402cd8f1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:42.939766 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3093b34a-e403-4437-81b2-ec2b402cd8f1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:42.943131 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3093b34a-e403-4437-81b2-ec2b402cd8f1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:42.944096 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3093b34a-e403-4437-81b2-ec2b402cd8f1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:43.314221 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8a6911c4-2a34-4b20-b30a-781b46442935 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:43.315132 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8a6911c4-2a34-4b20-b30a-781b46442935 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:43.324819 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8a6911c4-2a34-4b20-b30a-781b46442935 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:43.330959 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8a6911c4-2a34-4b20-b30a-781b46442935 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:43.332858 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8a6911c4-2a34-4b20-b30a-781b46442935 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:43.336379 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8a6911c4-2a34-4b20-b30a-781b46442935 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:43.658894 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3093b34a-e403-4437-81b2-ec2b402cd8f1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:43.678379 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3093b34a-e403-4437-81b2-ec2b402cd8f1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:43.690089 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3093b34a-e403-4437-81b2-ec2b402cd8f1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:43.691405 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3093b34a-e403-4437-81b2-ec2b402cd8f1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1406 microversion: 2.20 time: 0.773240 Jun 27 21:16:43.694626 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 62/114] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:42 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1406 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:43.706294 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ff605800-2b35-4ace-accf-75f469b4027a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:43.707566 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ff605800-2b35-4ace-accf-75f469b4027a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:43.721838 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ff605800-2b35-4ace-accf-75f469b4027a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:43.722493 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ff605800-2b35-4ace-accf-75f469b4027a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:43.724457 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ff605800-2b35-4ace-accf-75f469b4027a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:43.725513 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ff605800-2b35-4ace-accf-75f469b4027a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:43.990110 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ff605800-2b35-4ace-accf-75f469b4027a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:44.035579 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ff605800-2b35-4ace-accf-75f469b4027a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1321 microversion: 2.1 time: 0.338425 Jun 27 21:16:44.036467 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 63/115] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:43 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1321 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:44.040450 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8a6911c4-2a34-4b20-b30a-781b46442935 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:44.049264 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8a6911c4-2a34-4b20-b30a-781b46442935 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1365 microversion: 2.1 time: 0.740466 Jun 27 21:16:44.053706 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 53/116] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:43 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1365 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:44.066020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-dd1b51f5-913e-4441-a042-1931bd20316c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:44.067201 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-dd1b51f5-913e-4441-a042-1931bd20316c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:44.076881 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dd1b51f5-913e-4441-a042-1931bd20316c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:44.077583 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dd1b51f5-913e-4441-a042-1931bd20316c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:44.095219 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dd1b51f5-913e-4441-a042-1931bd20316c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:44.095814 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dd1b51f5-913e-4441-a042-1931bd20316c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:44.199045 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-b8004aa3-f269-4d0c-aec0-8da9b1a512ee req-997a320d-d3f5-4207-a1d2-97e93f872f87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53419a08-6ab0-4f25-82f9-81496ca7440e", "name": "network-vif-plugged", "status": "completed", "tag": "e0071d9d-e534-4717-a5e1-b60e19b215c7"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:44.213739 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-b8004aa3-f269-4d0c-aec0-8da9b1a512ee req-997a320d-d3f5-4207-a1d2-97e93f872f87 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:44.214562 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-b8004aa3-f269-4d0c-aec0-8da9b1a512ee req-997a320d-d3f5-4207-a1d2-97e93f872f87 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:44.235590 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-b8004aa3-f269-4d0c-aec0-8da9b1a512ee req-997a320d-d3f5-4207-a1d2-97e93f872f87 service nova] Creating event network-vif-plugged:e0071d9d-e534-4717-a5e1-b60e19b215c7 for instance 53419a08-6ab0-4f25-82f9-81496ca7440e on hv-cinder-84773 Jun 27 21:16:44.242042 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-b8004aa3-f269-4d0c-aec0-8da9b1a512ee req-997a320d-d3f5-4207-a1d2-97e93f872f87 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186743 Jun 27 21:16:44.243151 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 54/117] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:44.251216 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-be7b956c-5574-4a83-b6e8-eb11834056f8 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:44.251978 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-be7b956c-5574-4a83-b6e8-eb11834056f8 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:44.259376 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-be7b956c-5574-4a83-b6e8-eb11834056f8 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:44.259946 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-be7b956c-5574-4a83-b6e8-eb11834056f8 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:44.260723 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-be7b956c-5574-4a83-b6e8-eb11834056f8 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:44.261422 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-be7b956c-5574-4a83-b6e8-eb11834056f8 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:44.393403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-dd1b51f5-913e-4441-a042-1931bd20316c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:44.403777 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-dd1b51f5-913e-4441-a042-1931bd20316c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1364 microversion: 2.1 time: 0.364774 Jun 27 21:16:44.404471 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 64/118] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:44 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1364 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:44.409188 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-425cf02e-c397-47d6-85fa-36643f0e523e req-e42ee72c-27d5-4eed-8bb2-6ba61c6c4246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b28fb7f-5684-4656-bd7c-b6d7d15790b1", "tag": "c722f6d7-3bed-4343-ad5e-1c84bfc3ac4e"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:44.419929 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-425cf02e-c397-47d6-85fa-36643f0e523e req-e42ee72c-27d5-4eed-8bb2-6ba61c6c4246 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:44.420642 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-425cf02e-c397-47d6-85fa-36643f0e523e req-e42ee72c-27d5-4eed-8bb2-6ba61c6c4246 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:44.435002 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-425cf02e-c397-47d6-85fa-36643f0e523e req-e42ee72c-27d5-4eed-8bb2-6ba61c6c4246 service nova] Creating event network-changed:c722f6d7-3bed-4343-ad5e-1c84bfc3ac4e for instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 on hv-cinder-84773 Jun 27 21:16:44.440205 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-425cf02e-c397-47d6-85fa-36643f0e523e req-e42ee72c-27d5-4eed-8bb2-6ba61c6c4246 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034468 Jun 27 21:16:44.441049 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 65/119] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:44.501039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-be7b956c-5574-4a83-b6e8-eb11834056f8 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:44.524830 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-be7b956c-5574-4a83-b6e8-eb11834056f8 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1315 microversion: 2.1 time: 0.277926 Jun 27 21:16:44.527065 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 55/120] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:44 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:44.717280 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-33045ff0-da27-4d11-a64c-ce91c1a63371 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:44.718001 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-33045ff0-da27-4d11-a64c-ce91c1a63371 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:44.742303 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-33045ff0-da27-4d11-a64c-ce91c1a63371 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:44.745056 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-33045ff0-da27-4d11-a64c-ce91c1a63371 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:44.751425 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-33045ff0-da27-4d11-a64c-ce91c1a63371 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:44.752052 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-33045ff0-da27-4d11-a64c-ce91c1a63371 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:45.067055 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6b8946b3-3879-40de-abc9-1ae5ee536633 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:45.067679 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6b8946b3-3879-40de-abc9-1ae5ee536633 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:45.099249 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6b8946b3-3879-40de-abc9-1ae5ee536633 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:45.099373 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6b8946b3-3879-40de-abc9-1ae5ee536633 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:45.116658 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6b8946b3-3879-40de-abc9-1ae5ee536633 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:45.122318 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6b8946b3-3879-40de-abc9-1ae5ee536633 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:45.213843 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-33045ff0-da27-4d11-a64c-ce91c1a63371 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:45.223628 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-33045ff0-da27-4d11-a64c-ce91c1a63371 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:45.225164 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-33045ff0-da27-4d11-a64c-ce91c1a63371 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:45.237771 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-33045ff0-da27-4d11-a64c-ce91c1a63371 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1406 microversion: 2.20 time: 0.529420 Jun 27 21:16:45.240394 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 66/121] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:44 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1406 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:45.252862 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-467eff81-3ebb-4a87-8fbe-7ce099a8dae9 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:45.253519 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-467eff81-3ebb-4a87-8fbe-7ce099a8dae9 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:45.265492 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-467eff81-3ebb-4a87-8fbe-7ce099a8dae9 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:45.266735 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-467eff81-3ebb-4a87-8fbe-7ce099a8dae9 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:45.267894 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-467eff81-3ebb-4a87-8fbe-7ce099a8dae9 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:45.268510 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-467eff81-3ebb-4a87-8fbe-7ce099a8dae9 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:45.551363 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-467eff81-3ebb-4a87-8fbe-7ce099a8dae9 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:45.559269 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-467eff81-3ebb-4a87-8fbe-7ce099a8dae9 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1365 microversion: 2.1 time: 0.317719 Jun 27 21:16:45.559867 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 67/122] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:45 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1365 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:45.585791 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-25a1a542-a96f-4b98-8a8d-81f8434bb433 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:45.586437 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-25a1a542-a96f-4b98-8a8d-81f8434bb433 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:45.604742 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-25a1a542-a96f-4b98-8a8d-81f8434bb433 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:45.605238 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-25a1a542-a96f-4b98-8a8d-81f8434bb433 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:45.606014 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-25a1a542-a96f-4b98-8a8d-81f8434bb433 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:45.606445 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-25a1a542-a96f-4b98-8a8d-81f8434bb433 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:45.861351 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6b8946b3-3879-40de-abc9-1ae5ee536633 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:45.870140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6b8946b3-3879-40de-abc9-1ae5ee536633 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1321 microversion: 2.1 time: 0.815870 Jun 27 21:16:45.887242 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 56/123] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:45 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1321 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:45.896742 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-daa9e4a2-cfed-4279-911d-24b5daf3c395 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:45.902403 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-daa9e4a2-cfed-4279-911d-24b5daf3c395 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:45.911733 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-daa9e4a2-cfed-4279-911d-24b5daf3c395 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:45.913881 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-daa9e4a2-cfed-4279-911d-24b5daf3c395 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:45.916398 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-daa9e4a2-cfed-4279-911d-24b5daf3c395 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:45.917415 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-daa9e4a2-cfed-4279-911d-24b5daf3c395 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:45.938222 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-25a1a542-a96f-4b98-8a8d-81f8434bb433 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:45.951877 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-25a1a542-a96f-4b98-8a8d-81f8434bb433 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1364 microversion: 2.1 time: 0.380723 Jun 27 21:16:45.952426 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 68/124] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:45 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1364 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:46.167953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-daa9e4a2-cfed-4279-911d-24b5daf3c395 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:46.179055 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-daa9e4a2-cfed-4279-911d-24b5daf3c395 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1315 microversion: 2.1 time: 0.286754 Jun 27 21:16:46.179649 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 57/125] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:45 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:46.257606 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-167ae28a-d25f-4abe-94de-279ea8630483 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:46.258375 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-167ae28a-d25f-4abe-94de-279ea8630483 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:46.267174 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-167ae28a-d25f-4abe-94de-279ea8630483 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:46.267592 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-167ae28a-d25f-4abe-94de-279ea8630483 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:46.268358 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-167ae28a-d25f-4abe-94de-279ea8630483 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:46.268905 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-b03a0df4-b4ed-4a64-a8ab-13e729c3f2fa req-26c9e5af-647b-4c5d-be76-ee67aa7aed2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d240a8f-534e-471d-817b-3d79b449bfeb", "name": "network-vif-plugged", "status": "completed", "tag": "a6130374-d711-4d19-a701-67a2bc874882"}, {"server_uuid": "977f8cd5-d96e-4a13-b043-405e5c4325f1", "name": "network-vif-plugged", "status": "completed", "tag": "f88b5f5e-d7cd-4400-8ce9-9cede29542e2"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:46.269976 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-167ae28a-d25f-4abe-94de-279ea8630483 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:46.282005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-b03a0df4-b4ed-4a64-a8ab-13e729c3f2fa req-26c9e5af-647b-4c5d-be76-ee67aa7aed2f service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:46.282656 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-b03a0df4-b4ed-4a64-a8ab-13e729c3f2fa req-26c9e5af-647b-4c5d-be76-ee67aa7aed2f service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:46.300010 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-b03a0df4-b4ed-4a64-a8ab-13e729c3f2fa req-26c9e5af-647b-4c5d-be76-ee67aa7aed2f service nova] Creating event network-vif-plugged:a6130374-d711-4d19-a701-67a2bc874882 for instance 4d240a8f-534e-471d-817b-3d79b449bfeb on hv-cinder-84773 Jun 27 21:16:46.300772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-b03a0df4-b4ed-4a64-a8ab-13e729c3f2fa req-26c9e5af-647b-4c5d-be76-ee67aa7aed2f service nova] Creating event network-vif-plugged:f88b5f5e-d7cd-4400-8ce9-9cede29542e2 for instance 977f8cd5-d96e-4a13-b043-405e5c4325f1 on hv-cinder-84773 Jun 27 21:16:46.309370 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-b03a0df4-b4ed-4a64-a8ab-13e729c3f2fa req-26c9e5af-647b-4c5d-be76-ee67aa7aed2f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050156 Jun 27 21:16:46.310832 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 58/126] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:16:46.550339 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-167ae28a-d25f-4abe-94de-279ea8630483 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:46.561269 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-167ae28a-d25f-4abe-94de-279ea8630483 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:46.563009 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-167ae28a-d25f-4abe-94de-279ea8630483 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:46.570532 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-167ae28a-d25f-4abe-94de-279ea8630483 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1406 microversion: 2.20 time: 0.312215 Jun 27 21:16:46.570532 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 69/127] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:46 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1406 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:46.579498 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8459e70b-2fbb-4d9e-9f0d-722e9c7d527b tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:46.580199 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8459e70b-2fbb-4d9e-9f0d-722e9c7d527b tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:46.588804 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8459e70b-2fbb-4d9e-9f0d-722e9c7d527b tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:46.589502 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8459e70b-2fbb-4d9e-9f0d-722e9c7d527b tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:46.590626 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8459e70b-2fbb-4d9e-9f0d-722e9c7d527b tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:46.591433 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8459e70b-2fbb-4d9e-9f0d-722e9c7d527b tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:46.783158 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8459e70b-2fbb-4d9e-9f0d-722e9c7d527b tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:46.790694 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8459e70b-2fbb-4d9e-9f0d-722e9c7d527b tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1365 microversion: 2.1 time: 0.217666 Jun 27 21:16:46.791278 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 59/128] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:46 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:46.891271 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8d411ca9-4453-43c2-8c57-a482a44535eb tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:46.894129 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-8d411ca9-4453-43c2-8c57-a482a44535eb tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:46.913904 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8d411ca9-4453-43c2-8c57-a482a44535eb tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:46.917507 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8d411ca9-4453-43c2-8c57-a482a44535eb tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:46.920554 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8d411ca9-4453-43c2-8c57-a482a44535eb tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:46.922398 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8d411ca9-4453-43c2-8c57-a482a44535eb tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:46.968494 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=100 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:46.973892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e5575093-8307-469e-8227-16ba28d8e086 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:46.975687 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e5575093-8307-469e-8227-16ba28d8e086 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:46.984196 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e5575093-8307-469e-8227-16ba28d8e086 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:46.985661 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e5575093-8307-469e-8227-16ba28d8e086 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:46.986715 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e5575093-8307-469e-8227-16ba28d8e086 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:46.987445 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e5575093-8307-469e-8227-16ba28d8e086 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:47.142670 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8d411ca9-4453-43c2-8c57-a482a44535eb tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:47.151889 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8d411ca9-4453-43c2-8c57-a482a44535eb tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1321 microversion: 2.1 time: 0.266917 Jun 27 21:16:47.152877 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 70/129] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:46 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:47.195680 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f6eae760-7e1c-4a3f-87bb-4d57aee1cfdb tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:47.196528 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f6eae760-7e1c-4a3f-87bb-4d57aee1cfdb tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:47.203439 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f6eae760-7e1c-4a3f-87bb-4d57aee1cfdb tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:47.203885 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f6eae760-7e1c-4a3f-87bb-4d57aee1cfdb tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:47.209268 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f6eae760-7e1c-4a3f-87bb-4d57aee1cfdb tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:47.211418 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f6eae760-7e1c-4a3f-87bb-4d57aee1cfdb tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:47.268164 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e5575093-8307-469e-8227-16ba28d8e086 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:47.283017 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e5575093-8307-469e-8227-16ba28d8e086 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1364 microversion: 2.1 time: 0.315416 Jun 27 21:16:47.284762 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 60/130] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:46 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1364 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:47.520807 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f6eae760-7e1c-4a3f-87bb-4d57aee1cfdb tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:47.525119 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f6eae760-7e1c-4a3f-87bb-4d57aee1cfdb tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1315 microversion: 2.1 time: 0.332569 Jun 27 21:16:47.536804 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 71/131] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:47 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:47.585369 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f294fcb9-6668-4808-b444-6b6176fdf1e1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:47.586424 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f294fcb9-6668-4808-b444-6b6176fdf1e1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:47.595058 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f294fcb9-6668-4808-b444-6b6176fdf1e1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:47.595681 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f294fcb9-6668-4808-b444-6b6176fdf1e1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:47.596905 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f294fcb9-6668-4808-b444-6b6176fdf1e1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:47.597514 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f294fcb9-6668-4808-b444-6b6176fdf1e1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:47.786513 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f294fcb9-6668-4808-b444-6b6176fdf1e1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:47.808807 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d6ab2fd9-cb2e-4155-b716-e93db98e6890 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:47.809700 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d6ab2fd9-cb2e-4155-b716-e93db98e6890 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:47.812002 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f294fcb9-6668-4808-b444-6b6176fdf1e1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:47.818959 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d6ab2fd9-cb2e-4155-b716-e93db98e6890 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:47.819602 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d6ab2fd9-cb2e-4155-b716-e93db98e6890 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:47.820594 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d6ab2fd9-cb2e-4155-b716-e93db98e6890 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:47.821222 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d6ab2fd9-cb2e-4155-b716-e93db98e6890 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:47.824129 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f294fcb9-6668-4808-b444-6b6176fdf1e1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:47.825729 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f294fcb9-6668-4808-b444-6b6176fdf1e1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1406 microversion: 2.20 time: 0.247458 Jun 27 21:16:47.831045 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 61/132] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:47 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1406 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:48.142130 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d6ab2fd9-cb2e-4155-b716-e93db98e6890 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:48.150723 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d6ab2fd9-cb2e-4155-b716-e93db98e6890 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1365 microversion: 2.1 time: 0.346643 Jun 27 21:16:48.151325 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 72/133] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:47 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1365 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:48.170712 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-59081bb5-faa0-45a8-beaf-b3f621f30d90 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:48.171385 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-59081bb5-faa0-45a8-beaf-b3f621f30d90 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:48.177666 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-59081bb5-faa0-45a8-beaf-b3f621f30d90 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:48.178111 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-59081bb5-faa0-45a8-beaf-b3f621f30d90 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:48.178986 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-59081bb5-faa0-45a8-beaf-b3f621f30d90 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:48.179342 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-59081bb5-faa0-45a8-beaf-b3f621f30d90 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:48.302718 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ebf3d10c-8cad-44cb-8b1c-2bc49d814015 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:48.303551 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ebf3d10c-8cad-44cb-8b1c-2bc49d814015 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:48.311035 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ebf3d10c-8cad-44cb-8b1c-2bc49d814015 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:48.311666 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ebf3d10c-8cad-44cb-8b1c-2bc49d814015 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:48.312747 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ebf3d10c-8cad-44cb-8b1c-2bc49d814015 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:48.313405 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ebf3d10c-8cad-44cb-8b1c-2bc49d814015 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:48.357928 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-59081bb5-faa0-45a8-beaf-b3f621f30d90 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:48.367964 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-59081bb5-faa0-45a8-beaf-b3f621f30d90 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1321 microversion: 2.1 time: 0.200940 Jun 27 21:16:48.368916 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 62/134] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:48 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:48.506979 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ebf3d10c-8cad-44cb-8b1c-2bc49d814015 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:48.521039 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ebf3d10c-8cad-44cb-8b1c-2bc49d814015 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1364 microversion: 2.1 time: 0.221679 Jun 27 21:16:48.527558 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 73/135] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:48 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:48.542556 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-203afff0-6fda-4449-a164-fb485601435b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:48.543271 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-203afff0-6fda-4449-a164-fb485601435b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:48.553244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-203afff0-6fda-4449-a164-fb485601435b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:48.557534 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-203afff0-6fda-4449-a164-fb485601435b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:48.558379 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-203afff0-6fda-4449-a164-fb485601435b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:48.558873 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-203afff0-6fda-4449-a164-fb485601435b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:48.810422 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-203afff0-6fda-4449-a164-fb485601435b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:48.818582 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-203afff0-6fda-4449-a164-fb485601435b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1315 microversion: 2.1 time: 0.280038 Jun 27 21:16:48.820129 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 63/136] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:48 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:48.851731 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ad25a4da-c022-4407-ab07-88198ec76c9b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:48.852412 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ad25a4da-c022-4407-ab07-88198ec76c9b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:48.861602 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ad25a4da-c022-4407-ab07-88198ec76c9b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:48.862327 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ad25a4da-c022-4407-ab07-88198ec76c9b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:48.863529 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ad25a4da-c022-4407-ab07-88198ec76c9b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:48.864277 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ad25a4da-c022-4407-ab07-88198ec76c9b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:49.067970 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ad25a4da-c022-4407-ab07-88198ec76c9b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:49.084104 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ad25a4da-c022-4407-ab07-88198ec76c9b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:49.088500 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ad25a4da-c022-4407-ab07-88198ec76c9b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:49.092287 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ad25a4da-c022-4407-ab07-88198ec76c9b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1406 microversion: 2.20 time: 0.245665 Jun 27 21:16:49.105511 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 74/137] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:48 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1406 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:49.167913 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-751e79a0-65e5-4dd0-a2c9-7a1d48ceda50 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:49.168534 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-751e79a0-65e5-4dd0-a2c9-7a1d48ceda50 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:49.175333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-751e79a0-65e5-4dd0-a2c9-7a1d48ceda50 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:49.176019 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-751e79a0-65e5-4dd0-a2c9-7a1d48ceda50 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:49.176628 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-751e79a0-65e5-4dd0-a2c9-7a1d48ceda50 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:49.177352 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-751e79a0-65e5-4dd0-a2c9-7a1d48ceda50 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:49.328513 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-751e79a0-65e5-4dd0-a2c9-7a1d48ceda50 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:49.336284 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-751e79a0-65e5-4dd0-a2c9-7a1d48ceda50 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1365 microversion: 2.1 time: 0.172493 Jun 27 21:16:49.336864 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 64/138] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:49 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:49.387300 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-89bec354-4d1d-49df-87d3-fa1a31cd2a1c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:49.387884 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-89bec354-4d1d-49df-87d3-fa1a31cd2a1c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:49.394349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-89bec354-4d1d-49df-87d3-fa1a31cd2a1c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:49.394793 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-89bec354-4d1d-49df-87d3-fa1a31cd2a1c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:49.395554 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-89bec354-4d1d-49df-87d3-fa1a31cd2a1c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:49.395983 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-89bec354-4d1d-49df-87d3-fa1a31cd2a1c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:49.535154 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-89bec354-4d1d-49df-87d3-fa1a31cd2a1c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:49.541902 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-00e492f1-aa9e-42cc-80a8-06cea02ba94f tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:49.542529 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-00e492f1-aa9e-42cc-80a8-06cea02ba94f tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:49.546802 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-89bec354-4d1d-49df-87d3-fa1a31cd2a1c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1321 microversion: 2.1 time: 0.163369 Jun 27 21:16:49.547804 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 75/139] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:49 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:49.557350 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-00e492f1-aa9e-42cc-80a8-06cea02ba94f tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:49.557993 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-00e492f1-aa9e-42cc-80a8-06cea02ba94f tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:49.558970 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-00e492f1-aa9e-42cc-80a8-06cea02ba94f tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:49.559450 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-00e492f1-aa9e-42cc-80a8-06cea02ba94f tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:49.705267 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-00e492f1-aa9e-42cc-80a8-06cea02ba94f tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:49.714448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-00e492f1-aa9e-42cc-80a8-06cea02ba94f tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1364 microversion: 2.1 time: 0.178303 Jun 27 21:16:49.715031 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 65/140] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:49 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:49.835842 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ffa77b17-9b1b-454e-a205-5eeac2635d24 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:49.836425 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ffa77b17-9b1b-454e-a205-5eeac2635d24 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:49.843538 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ffa77b17-9b1b-454e-a205-5eeac2635d24 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:49.844374 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ffa77b17-9b1b-454e-a205-5eeac2635d24 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:49.845437 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ffa77b17-9b1b-454e-a205-5eeac2635d24 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:49.845952 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ffa77b17-9b1b-454e-a205-5eeac2635d24 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:50.026872 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ffa77b17-9b1b-454e-a205-5eeac2635d24 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:50.038444 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ffa77b17-9b1b-454e-a205-5eeac2635d24 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1315 microversion: 2.1 time: 0.206155 Jun 27 21:16:50.039710 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 76/141] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:49 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:50.122602 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-14d843c0-d0e3-413b-8048-9125d68d4c70 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:50.123528 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-14d843c0-d0e3-413b-8048-9125d68d4c70 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:50.134318 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-14d843c0-d0e3-413b-8048-9125d68d4c70 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:50.136216 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-14d843c0-d0e3-413b-8048-9125d68d4c70 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:50.137990 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-14d843c0-d0e3-413b-8048-9125d68d4c70 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:50.139069 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-14d843c0-d0e3-413b-8048-9125d68d4c70 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:50.181572 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-3029a2d6-a39a-4911-a113-a7025b7f029b req-f1e2a70a-88db-4409-b523-b8f761735c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfecef68-0f46-4744-8dc0-d721f692710b", "name": "network-vif-plugged", "status": "completed", "tag": "baa095fe-f218-45c8-b731-2f6078fc2222"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:50.196232 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-3029a2d6-a39a-4911-a113-a7025b7f029b req-f1e2a70a-88db-4409-b523-b8f761735c37 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:50.198889 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-3029a2d6-a39a-4911-a113-a7025b7f029b req-f1e2a70a-88db-4409-b523-b8f761735c37 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:50.224076 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-3029a2d6-a39a-4911-a113-a7025b7f029b req-f1e2a70a-88db-4409-b523-b8f761735c37 service nova] Creating event network-vif-plugged:baa095fe-f218-45c8-b731-2f6078fc2222 for instance cfecef68-0f46-4744-8dc0-d721f692710b on hv-cinder-84773 Jun 27 21:16:50.237624 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-3029a2d6-a39a-4911-a113-a7025b7f029b req-f1e2a70a-88db-4409-b523-b8f761735c37 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060544 Jun 27 21:16:50.238731 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 77/142] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:50.356829 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ab458a3f-c029-4827-a48c-7ae521a57d39 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:50.358068 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ab458a3f-c029-4827-a48c-7ae521a57d39 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:50.371729 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-14d843c0-d0e3-413b-8048-9125d68d4c70 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:50.373528 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ab458a3f-c029-4827-a48c-7ae521a57d39 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:50.374142 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ab458a3f-c029-4827-a48c-7ae521a57d39 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:50.377944 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ab458a3f-c029-4827-a48c-7ae521a57d39 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:50.378575 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ab458a3f-c029-4827-a48c-7ae521a57d39 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:50.384992 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-14d843c0-d0e3-413b-8048-9125d68d4c70 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:50.387189 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-14d843c0-d0e3-413b-8048-9125d68d4c70 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:50.389304 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-14d843c0-d0e3-413b-8048-9125d68d4c70 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1406 microversion: 2.20 time: 0.273275 Jun 27 21:16:50.390110 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 66/143] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:50 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1406 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:50.562296 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ab458a3f-c029-4827-a48c-7ae521a57d39 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:50.564775 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-21b76560-9971-4768-8f8f-f583a2364bee tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:50.565540 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-21b76560-9971-4768-8f8f-f583a2364bee tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:50.573630 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-21b76560-9971-4768-8f8f-f583a2364bee tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:50.573997 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ab458a3f-c029-4827-a48c-7ae521a57d39 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1365 microversion: 2.1 time: 0.223068 Jun 27 21:16:50.574531 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-21b76560-9971-4768-8f8f-f583a2364bee tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:50.575466 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-21b76560-9971-4768-8f8f-f583a2364bee tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:50.576192 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-21b76560-9971-4768-8f8f-f583a2364bee tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:50.584073 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 78/144] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:50 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:50.724236 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-21b76560-9971-4768-8f8f-f583a2364bee tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:50.733586 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-21b76560-9971-4768-8f8f-f583a2364bee tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1515 microversion: 2.1 time: 0.172573 Jun 27 21:16:50.734174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 67/145] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:50 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:50.748594 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d82e00fa-e7fa-4279-8872-9d3ce9a3a385 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:50.751861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b1edae41-a1ec-4002-9436-58ab1e7fce70 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:50.752439 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d82e00fa-e7fa-4279-8872-9d3ce9a3a385 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:50.753321 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b1edae41-a1ec-4002-9436-58ab1e7fce70 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:50.755697 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:50.764008 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b1edae41-a1ec-4002-9436-58ab1e7fce70 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:50.764440 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b1edae41-a1ec-4002-9436-58ab1e7fce70 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:50.765916 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b1edae41-a1ec-4002-9436-58ab1e7fce70 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:50.766787 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b1edae41-a1ec-4002-9436-58ab1e7fce70 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:50.767281 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d82e00fa-e7fa-4279-8872-9d3ce9a3a385 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:50.767769 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d82e00fa-e7fa-4279-8872-9d3ce9a3a385 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:50.771094 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d82e00fa-e7fa-4279-8872-9d3ce9a3a385 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:50.773179 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d82e00fa-e7fa-4279-8872-9d3ce9a3a385 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:50.843975 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-b1edae41-a1ec-4002-9436-58ab1e7fce70 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lazy-loading 'flavor' on Instance uuid 4d240a8f-534e-471d-817b-3d79b449bfeb {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:16:50.883921 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:50.982358 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d82e00fa-e7fa-4279-8872-9d3ce9a3a385 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:50.990975 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d82e00fa-e7fa-4279-8872-9d3ce9a3a385 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1364 microversion: 2.1 time: 0.263134 Jun 27 21:16:50.991552 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 79/146] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:50 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1364 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:50.997117 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b1edae41-a1ec-4002-9436-58ab1e7fce70 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "POST /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb/action" status: 200 len: 32 microversion: 2.1 time: 0.249985 Jun 27 21:16:50.998021 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 68/147] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 27 21:16:50 2022] POST /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb/action => generated 32 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 27 21:16:51.009759 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c35fe65d-88ae-428e-be9f-e8fcf010f0e8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:51.010355 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c35fe65d-88ae-428e-be9f-e8fcf010f0e8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:51.016519 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c35fe65d-88ae-428e-be9f-e8fcf010f0e8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:51.017256 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c35fe65d-88ae-428e-be9f-e8fcf010f0e8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:51.018198 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c35fe65d-88ae-428e-be9f-e8fcf010f0e8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:51.018965 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c35fe65d-88ae-428e-be9f-e8fcf010f0e8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:51.056500 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0becc831-ff79-484f-a615-900d81b2fd86 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:51.057519 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0becc831-ff79-484f-a615-900d81b2fd86 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:51.064246 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0becc831-ff79-484f-a615-900d81b2fd86 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:51.064819 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0becc831-ff79-484f-a615-900d81b2fd86 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:51.065665 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0becc831-ff79-484f-a615-900d81b2fd86 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:51.066181 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0becc831-ff79-484f-a615-900d81b2fd86 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:51.177103 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c35fe65d-88ae-428e-be9f-e8fcf010f0e8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:51.193242 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c35fe65d-88ae-428e-be9f-e8fcf010f0e8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.187208 Jun 27 21:16:51.194380 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 80/148] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:51 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:51.230010 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0becc831-ff79-484f-a615-900d81b2fd86 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:51.243885 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0becc831-ff79-484f-a615-900d81b2fd86 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1315 microversion: 2.1 time: 0.191033 Jun 27 21:16:51.253306 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 69/149] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:51 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:51.409895 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ebd001b2-1ab5-4c5f-aea9-1db3aa0ec7ab tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:51.411007 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ebd001b2-1ab5-4c5f-aea9-1db3aa0ec7ab tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:51.419570 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ebd001b2-1ab5-4c5f-aea9-1db3aa0ec7ab tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:51.420251 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ebd001b2-1ab5-4c5f-aea9-1db3aa0ec7ab tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:51.421447 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ebd001b2-1ab5-4c5f-aea9-1db3aa0ec7ab tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:51.422257 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ebd001b2-1ab5-4c5f-aea9-1db3aa0ec7ab tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:51.595886 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-56cabaf5-e57b-4236-92eb-60379ee920d1 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:51.597105 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-56cabaf5-e57b-4236-92eb-60379ee920d1 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:51.607925 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-56cabaf5-e57b-4236-92eb-60379ee920d1 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:51.608786 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-56cabaf5-e57b-4236-92eb-60379ee920d1 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:51.609839 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-56cabaf5-e57b-4236-92eb-60379ee920d1 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:51.610802 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-56cabaf5-e57b-4236-92eb-60379ee920d1 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:51.915097 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-56cabaf5-e57b-4236-92eb-60379ee920d1 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:51.923286 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-56cabaf5-e57b-4236-92eb-60379ee920d1 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1365 microversion: 2.1 time: 0.335153 Jun 27 21:16:51.924302 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 70/150] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:51 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1365 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:52.011758 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-763e71ae-c35b-4046-bf0f-6ec1734baff5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:52.012536 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-763e71ae-c35b-4046-bf0f-6ec1734baff5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:52.029436 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-763e71ae-c35b-4046-bf0f-6ec1734baff5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:52.030221 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-763e71ae-c35b-4046-bf0f-6ec1734baff5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:52.031200 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-763e71ae-c35b-4046-bf0f-6ec1734baff5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:52.031775 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-763e71ae-c35b-4046-bf0f-6ec1734baff5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:52.061035 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ebd001b2-1ab5-4c5f-aea9-1db3aa0ec7ab tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:52.076071 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ebd001b2-1ab5-4c5f-aea9-1db3aa0ec7ab tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:52.077717 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ebd001b2-1ab5-4c5f-aea9-1db3aa0ec7ab tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:52.079082 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ebd001b2-1ab5-4c5f-aea9-1db3aa0ec7ab tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1406 microversion: 2.20 time: 0.676049 Jun 27 21:16:52.079760 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 81/151] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:51 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1406 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:52.214606 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a26481a9-c6fe-4873-9801-d34f3661c1d1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:52.215630 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a26481a9-c6fe-4873-9801-d34f3661c1d1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:52.224465 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a26481a9-c6fe-4873-9801-d34f3661c1d1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:52.233531 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a26481a9-c6fe-4873-9801-d34f3661c1d1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:52.234646 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a26481a9-c6fe-4873-9801-d34f3661c1d1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:52.235316 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a26481a9-c6fe-4873-9801-d34f3661c1d1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:52.263338 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-763e71ae-c35b-4046-bf0f-6ec1734baff5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:52.273329 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-763e71ae-c35b-4046-bf0f-6ec1734baff5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1549 microversion: 2.1 time: 0.265425 Jun 27 21:16:52.274143 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 71/152] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:52 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1549 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:52.279452 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8ef16cf2-9396-4d76-8bf3-aab0df1594b4 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:52.280250 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8ef16cf2-9396-4d76-8bf3-aab0df1594b4 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:52.288548 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ef16cf2-9396-4d76-8bf3-aab0df1594b4 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:52.289388 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ef16cf2-9396-4d76-8bf3-aab0df1594b4 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:52.290404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ef16cf2-9396-4d76-8bf3-aab0df1594b4 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:52.291001 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ef16cf2-9396-4d76-8bf3-aab0df1594b4 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:52.392674 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a26481a9-c6fe-4873-9801-d34f3661c1d1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:52.400753 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a26481a9-c6fe-4873-9801-d34f3661c1d1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.193837 Jun 27 21:16:52.401374 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 82/153] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:52 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:52.410421 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4fb2496e-ae70-4acf-85cf-329973c988ee tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:52.410421 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4fb2496e-ae70-4acf-85cf-329973c988ee tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:52.413250 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4fb2496e-ae70-4acf-85cf-329973c988ee tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:52.413692 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4fb2496e-ae70-4acf-85cf-329973c988ee tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:52.414462 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4fb2496e-ae70-4acf-85cf-329973c988ee tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:52.414902 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4fb2496e-ae70-4acf-85cf-329973c988ee tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:52.543425 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4fb2496e-ae70-4acf-85cf-329973c988ee tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.140942 Jun 27 21:16:52.544022 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 83/154] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 27 21:16:52 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:52.548767 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-4b716440-da72-4d3f-8cbe-54afc4d91933 req-17b20ec7-2561-436b-9c14-04b13870d72d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a76ab5-ca81-472e-8d89-69e63b684ae3", "name": "network-vif-plugged", "status": "completed", "tag": "6de54808-7215-48a3-8344-ee5680120151"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:52.566765 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-4b716440-da72-4d3f-8cbe-54afc4d91933 req-17b20ec7-2561-436b-9c14-04b13870d72d service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:52.567291 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-4b716440-da72-4d3f-8cbe-54afc4d91933 req-17b20ec7-2561-436b-9c14-04b13870d72d service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:52.580299 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-4b716440-da72-4d3f-8cbe-54afc4d91933 req-17b20ec7-2561-436b-9c14-04b13870d72d service nova] Creating event network-vif-plugged:6de54808-7215-48a3-8344-ee5680120151 for instance b2a76ab5-ca81-472e-8d89-69e63b684ae3 on hv-cinder-84773 Jun 27 21:16:52.585821 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-4b716440-da72-4d3f-8cbe-54afc4d91933 req-17b20ec7-2561-436b-9c14-04b13870d72d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040479 Jun 27 21:16:52.586739 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 84/155] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:52.692958 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8ef16cf2-9396-4d76-8bf3-aab0df1594b4 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:52.701932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8ef16cf2-9396-4d76-8bf3-aab0df1594b4 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1315 microversion: 2.1 time: 0.426255 Jun 27 21:16:52.711165 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 72/156] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:52 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1315 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:52.944054 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a5a37891-84d2-480e-89a4-55736522275e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:52.945210 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a5a37891-84d2-480e-89a4-55736522275e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:52.961613 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a5a37891-84d2-480e-89a4-55736522275e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:52.962358 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a5a37891-84d2-480e-89a4-55736522275e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:52.964331 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a5a37891-84d2-480e-89a4-55736522275e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:52.964886 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a5a37891-84d2-480e-89a4-55736522275e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:53.111840 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5b769806-4f8d-4230-9e8a-46395447bbc8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:53.112521 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5b769806-4f8d-4230-9e8a-46395447bbc8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:53.137310 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5b769806-4f8d-4230-9e8a-46395447bbc8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:53.138394 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5b769806-4f8d-4230-9e8a-46395447bbc8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:53.139619 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5b769806-4f8d-4230-9e8a-46395447bbc8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:53.140323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5b769806-4f8d-4230-9e8a-46395447bbc8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:53.413920 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5b769806-4f8d-4230-9e8a-46395447bbc8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:53.426465 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a5a37891-84d2-480e-89a4-55736522275e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:53.456298 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a5a37891-84d2-480e-89a4-55736522275e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1365 microversion: 2.1 time: 0.516931 Jun 27 21:16:53.459603 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5b769806-4f8d-4230-9e8a-46395447bbc8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:53.461414 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5b769806-4f8d-4230-9e8a-46395447bbc8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:53.464387 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5b769806-4f8d-4230-9e8a-46395447bbc8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1406 microversion: 2.20 time: 0.360867 Jun 27 21:16:53.464941 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 73/157] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:53 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1406 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:16:53.473360 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 85/158] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:52 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1365 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:53.478203 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-103f09c7-d115-4f42-8e43-f16c32b674b5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:53.478987 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-103f09c7-d115-4f42-8e43-f16c32b674b5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:53.492813 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-103f09c7-d115-4f42-8e43-f16c32b674b5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:53.495194 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-103f09c7-d115-4f42-8e43-f16c32b674b5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:53.496038 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-103f09c7-d115-4f42-8e43-f16c32b674b5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:53.496474 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-103f09c7-d115-4f42-8e43-f16c32b674b5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:53.719240 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c4bf4954-61c4-43d6-b259-ef675e033749 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:53.720265 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c4bf4954-61c4-43d6-b259-ef675e033749 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:53.727366 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c4bf4954-61c4-43d6-b259-ef675e033749 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:53.727990 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c4bf4954-61c4-43d6-b259-ef675e033749 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:53.729069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c4bf4954-61c4-43d6-b259-ef675e033749 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:53.729802 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c4bf4954-61c4-43d6-b259-ef675e033749 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:53.761543 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-103f09c7-d115-4f42-8e43-f16c32b674b5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:53.771787 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-103f09c7-d115-4f42-8e43-f16c32b674b5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.305587 Jun 27 21:16:53.772700 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 74/159] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:53 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:54.283591 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c4bf4954-61c4-43d6-b259-ef675e033749 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:54.295115 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c4bf4954-61c4-43d6-b259-ef675e033749 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1502 microversion: 2.1 time: 0.579781 Jun 27 21:16:54.296058 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 86/160] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:53 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1502 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:54.490335 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-67cc3c52-1d05-4e45-b3c3-24c940b71735 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:54.491032 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-67cc3c52-1d05-4e45-b3c3-24c940b71735 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:54.491361 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f0505bda-f46e-4d2a-a42f-4a4106d9f110 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:54.491964 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f0505bda-f46e-4d2a-a42f-4a4106d9f110 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:54.500346 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-67cc3c52-1d05-4e45-b3c3-24c940b71735 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:54.500763 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-67cc3c52-1d05-4e45-b3c3-24c940b71735 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:54.503120 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f0505bda-f46e-4d2a-a42f-4a4106d9f110 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:54.504753 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f0505bda-f46e-4d2a-a42f-4a4106d9f110 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:54.507823 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-67cc3c52-1d05-4e45-b3c3-24c940b71735 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:54.508085 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-67cc3c52-1d05-4e45-b3c3-24c940b71735 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:54.509608 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f0505bda-f46e-4d2a-a42f-4a4106d9f110 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:54.512550 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f0505bda-f46e-4d2a-a42f-4a4106d9f110 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:54.826646 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f0505bda-f46e-4d2a-a42f-4a4106d9f110 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:54.843419 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f0505bda-f46e-4d2a-a42f-4a4106d9f110 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:54.846019 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f0505bda-f46e-4d2a-a42f-4a4106d9f110 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:54.847963 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f0505bda-f46e-4d2a-a42f-4a4106d9f110 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1406 microversion: 2.20 time: 0.364485 Jun 27 21:16:54.848826 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 75/161] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:54 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1406 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:54.858287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-c6cd188c-5a8f-49a9-a980-3e8eb4881b47 req-e6622e49-5d5a-4131-85b4-a69164d8c0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b28fb7f-5684-4656-bd7c-b6d7d15790b1", "name": "network-vif-plugged", "status": "completed", "tag": "c722f6d7-3bed-4343-ad5e-1c84bfc3ac4e"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:54.867618 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-c6cd188c-5a8f-49a9-a980-3e8eb4881b47 req-e6622e49-5d5a-4131-85b4-a69164d8c0d8 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:54.868375 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-c6cd188c-5a8f-49a9-a980-3e8eb4881b47 req-e6622e49-5d5a-4131-85b4-a69164d8c0d8 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:54.871996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-67cc3c52-1d05-4e45-b3c3-24c940b71735 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:54.883658 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-67cc3c52-1d05-4e45-b3c3-24c940b71735 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1365 microversion: 2.1 time: 0.399583 Jun 27 21:16:54.889940 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 87/162] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:54 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1365 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:54.903360 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d9443bd1-b23e-4d9f-b33f-9c0e5f5ef197 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:54.903687 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-c6cd188c-5a8f-49a9-a980-3e8eb4881b47 req-e6622e49-5d5a-4131-85b4-a69164d8c0d8 service nova] Creating event network-vif-plugged:c722f6d7-3bed-4343-ad5e-1c84bfc3ac4e for instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 on hv-cinder-84773 Jun 27 21:16:54.904114 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d9443bd1-b23e-4d9f-b33f-9c0e5f5ef197 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:54.909879 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-c6cd188c-5a8f-49a9-a980-3e8eb4881b47 req-e6622e49-5d5a-4131-85b4-a69164d8c0d8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059352 Jun 27 21:16:54.910645 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 76/163] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:54.914731 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d9443bd1-b23e-4d9f-b33f-9c0e5f5ef197 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:54.915298 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d9443bd1-b23e-4d9f-b33f-9c0e5f5ef197 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:54.916082 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d9443bd1-b23e-4d9f-b33f-9c0e5f5ef197 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:54.916510 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d9443bd1-b23e-4d9f-b33f-9c0e5f5ef197 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:54.921690 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-1ffeca90-a1e2-4eb2-8f14-39fd2996d614 req-48bbdad8-e371-4fe3-bd2f-2b131f194984 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "977f8cd5-d96e-4a13-b043-405e5c4325f1", "tag": "f88b5f5e-d7cd-4400-8ce9-9cede29542e2"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:54.938268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-1ffeca90-a1e2-4eb2-8f14-39fd2996d614 req-48bbdad8-e371-4fe3-bd2f-2b131f194984 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:54.938895 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-1ffeca90-a1e2-4eb2-8f14-39fd2996d614 req-48bbdad8-e371-4fe3-bd2f-2b131f194984 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:54.951789 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-1ffeca90-a1e2-4eb2-8f14-39fd2996d614 req-48bbdad8-e371-4fe3-bd2f-2b131f194984 service nova] Creating event network-changed:f88b5f5e-d7cd-4400-8ce9-9cede29542e2 for instance 977f8cd5-d96e-4a13-b043-405e5c4325f1 on hv-cinder-84773 Jun 27 21:16:54.957817 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-1ffeca90-a1e2-4eb2-8f14-39fd2996d614 req-48bbdad8-e371-4fe3-bd2f-2b131f194984 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041185 Jun 27 21:16:54.958650 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 77/164] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:55.112260 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d9443bd1-b23e-4d9f-b33f-9c0e5f5ef197 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:55.115683 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=100 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:55.123885 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d9443bd1-b23e-4d9f-b33f-9c0e5f5ef197 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.231265 Jun 27 21:16:55.124771 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 88/165] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:54 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:55.871669 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4a7cc018-66de-4efb-9f79-631298d5b653 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:55.872494 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4a7cc018-66de-4efb-9f79-631298d5b653 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:55.893507 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a7cc018-66de-4efb-9f79-631298d5b653 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:55.893956 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a7cc018-66de-4efb-9f79-631298d5b653 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:55.898803 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a7cc018-66de-4efb-9f79-631298d5b653 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:55.908743 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-cee374b9-6f66-403f-b191-e22c771a02dc tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:55.909967 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-cee374b9-6f66-403f-b191-e22c771a02dc tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:55.913940 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a7cc018-66de-4efb-9f79-631298d5b653 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:55.931747 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cee374b9-6f66-403f-b191-e22c771a02dc tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:55.932194 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cee374b9-6f66-403f-b191-e22c771a02dc tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:55.932986 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cee374b9-6f66-403f-b191-e22c771a02dc tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:55.933413 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cee374b9-6f66-403f-b191-e22c771a02dc tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:56.134489 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-cee374b9-6f66-403f-b191-e22c771a02dc tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:56.143628 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-cee374b9-6f66-403f-b191-e22c771a02dc tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1555 microversion: 2.1 time: 0.240324 Jun 27 21:16:56.144267 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 89/166] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:55 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1555 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:56.149085 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-361e90d1-b84a-4649-ba47-b3f828d0de00 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "651dc51b-7fc1-420b-bef9-4738abf1cfa8"}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:56.150387 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-361e90d1-b84a-4649-ba47-b3f828d0de00 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:56.156901 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-361e90d1-b84a-4649-ba47-b3f828d0de00 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:56.157419 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-361e90d1-b84a-4649-ba47-b3f828d0de00 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:56.158208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-361e90d1-b84a-4649-ba47-b3f828d0de00 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:56.158660 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-361e90d1-b84a-4649-ba47-b3f828d0de00 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:56.214283 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4a7cc018-66de-4efb-9f79-631298d5b653 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:56.225356 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4a7cc018-66de-4efb-9f79-631298d5b653 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:56.227571 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4a7cc018-66de-4efb-9f79-631298d5b653 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:56.229016 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4a7cc018-66de-4efb-9f79-631298d5b653 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1406 microversion: 2.20 time: 0.364763 Jun 27 21:16:56.230156 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 78/167] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:55 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1406 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:56.235272 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ec97a3ea-4a67-4319-b40e-0fb7fcc8950e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:56.236040 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ec97a3ea-4a67-4319-b40e-0fb7fcc8950e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:56.243136 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ec97a3ea-4a67-4319-b40e-0fb7fcc8950e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:56.244015 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ec97a3ea-4a67-4319-b40e-0fb7fcc8950e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:56.245094 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ec97a3ea-4a67-4319-b40e-0fb7fcc8950e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:56.245677 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ec97a3ea-4a67-4319-b40e-0fb7fcc8950e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:56.468000 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ec97a3ea-4a67-4319-b40e-0fb7fcc8950e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:56.486991 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ec97a3ea-4a67-4319-b40e-0fb7fcc8950e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.250630 Jun 27 21:16:56.486991 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 79/168] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:56 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:56.494042 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fa86978b-b18d-4b1e-870e-eb92c983e422 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:56.494424 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fa86978b-b18d-4b1e-870e-eb92c983e422 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:56.508964 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fa86978b-b18d-4b1e-870e-eb92c983e422 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:56.508964 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fa86978b-b18d-4b1e-870e-eb92c983e422 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:56.510188 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fa86978b-b18d-4b1e-870e-eb92c983e422 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:56.510188 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fa86978b-b18d-4b1e-870e-eb92c983e422 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:56.605534 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fa86978b-b18d-4b1e-870e-eb92c983e422 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121597 Jun 27 21:16:56.606140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 80/169] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 27 21:16:56 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:57.224063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-361e90d1-b84a-4649-ba47-b3f828d0de00 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "POST /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.078482 Jun 27 21:16:57.225736 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 90/170] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 27 21:16:56 2022] POST /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b/os-volume_attachments => generated 194 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:57.252373 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3e59f402-86ae-4522-9dfb-f643c684fb67 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:57.259977 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3e59f402-86ae-4522-9dfb-f643c684fb67 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:57.270895 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e59f402-86ae-4522-9dfb-f643c684fb67 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:57.275085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e59f402-86ae-4522-9dfb-f643c684fb67 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:57.280018 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e59f402-86ae-4522-9dfb-f643c684fb67 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:57.280468 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e59f402-86ae-4522-9dfb-f643c684fb67 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:57.501755 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-16078b81-6510-4712-86bd-2118e17707e4 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:57.503089 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-16078b81-6510-4712-86bd-2118e17707e4 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:57.512292 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-16078b81-6510-4712-86bd-2118e17707e4 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:57.513267 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-16078b81-6510-4712-86bd-2118e17707e4 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:57.514215 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-16078b81-6510-4712-86bd-2118e17707e4 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:57.514794 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-16078b81-6510-4712-86bd-2118e17707e4 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:57.601837 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3e59f402-86ae-4522-9dfb-f643c684fb67 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:57.617410 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3e59f402-86ae-4522-9dfb-f643c684fb67 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:57.620611 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3e59f402-86ae-4522-9dfb-f643c684fb67 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:57.622359 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3e59f402-86ae-4522-9dfb-f643c684fb67 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1406 microversion: 2.20 time: 0.377502 Jun 27 21:16:57.623270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 81/171] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:57 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1406 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:57.718836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-16078b81-6510-4712-86bd-2118e17707e4 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:57.727626 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-16078b81-6510-4712-86bd-2118e17707e4 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.231928 Jun 27 21:16:57.737536 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 91/172] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:57 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:58.388840 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-e17d418c-ff55-46ee-b6fb-0ec011d5cd8d req-8aefc0c8-5552-4240-b357-61520cc20628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2a76ab5-ca81-472e-8d89-69e63b684ae3", "tag": "6de54808-7215-48a3-8344-ee5680120151"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:58.403814 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-e17d418c-ff55-46ee-b6fb-0ec011d5cd8d req-8aefc0c8-5552-4240-b357-61520cc20628 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:58.404269 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-e17d418c-ff55-46ee-b6fb-0ec011d5cd8d req-8aefc0c8-5552-4240-b357-61520cc20628 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:58.417864 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-e17d418c-ff55-46ee-b6fb-0ec011d5cd8d req-8aefc0c8-5552-4240-b357-61520cc20628 service nova] Creating event network-changed:6de54808-7215-48a3-8344-ee5680120151 for instance b2a76ab5-ca81-472e-8d89-69e63b684ae3 on hv-cinder-84773 Jun 27 21:16:58.423531 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-e17d418c-ff55-46ee-b6fb-0ec011d5cd8d req-8aefc0c8-5552-4240-b357-61520cc20628 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039282 Jun 27 21:16:58.424512 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 82/173] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:58.641345 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9710d657-2f47-497f-93bb-fa4b13a9a654 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:58.642561 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9710d657-2f47-497f-93bb-fa4b13a9a654 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:58.650493 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9710d657-2f47-497f-93bb-fa4b13a9a654 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:58.651390 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9710d657-2f47-497f-93bb-fa4b13a9a654 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:58.652402 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9710d657-2f47-497f-93bb-fa4b13a9a654 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:58.653076 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9710d657-2f47-497f-93bb-fa4b13a9a654 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:58.752672 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-02c3c606-87c1-43c7-8e49-fe926bec7c1f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:58.754272 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-02c3c606-87c1-43c7-8e49-fe926bec7c1f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:58.775182 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02c3c606-87c1-43c7-8e49-fe926bec7c1f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:58.776413 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02c3c606-87c1-43c7-8e49-fe926bec7c1f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:58.779059 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02c3c606-87c1-43c7-8e49-fe926bec7c1f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:58.779636 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02c3c606-87c1-43c7-8e49-fe926bec7c1f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:58.890205 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9710d657-2f47-497f-93bb-fa4b13a9a654 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:58.899471 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9710d657-2f47-497f-93bb-fa4b13a9a654 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:58.902303 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9710d657-2f47-497f-93bb-fa4b13a9a654 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:58.903801 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9710d657-2f47-497f-93bb-fa4b13a9a654 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1597 microversion: 2.20 time: 0.266624 Jun 27 21:16:58.904575 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 92/174] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:58 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1597 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:58.926639 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5fa1cd93-6205-4526-b92c-d76266e3e961 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:58.927539 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-5fa1cd93-6205-4526-b92c-d76266e3e961 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:58.935763 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5fa1cd93-6205-4526-b92c-d76266e3e961 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:58.936491 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5fa1cd93-6205-4526-b92c-d76266e3e961 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:58.937459 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5fa1cd93-6205-4526-b92c-d76266e3e961 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:58.938255 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5fa1cd93-6205-4526-b92c-d76266e3e961 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:58.942441 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-02c3c606-87c1-43c7-8e49-fe926bec7c1f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:58.970282 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-02c3c606-87c1-43c7-8e49-fe926bec7c1f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.225087 Jun 27 21:16:58.970884 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 83/175] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:58 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:59.068208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5fa1cd93-6205-4526-b92c-d76266e3e961 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.146049 Jun 27 21:16:59.069767 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 93/176] 10.222.0.13 () {60 vars in 1315 bytes} [Mon Jun 27 21:16:58 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:16:59.987708 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5dc607bd-f128-4edd-81a6-81750fb45d17 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:59.988407 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5dc607bd-f128-4edd-81a6-81750fb45d17 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:59.994968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5dc607bd-f128-4edd-81a6-81750fb45d17 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:59.995486 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5dc607bd-f128-4edd-81a6-81750fb45d17 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:59.996278 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5dc607bd-f128-4edd-81a6-81750fb45d17 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:59.996998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5dc607bd-f128-4edd-81a6-81750fb45d17 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:00.558679 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5dc607bd-f128-4edd-81a6-81750fb45d17 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:00.569692 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5dc607bd-f128-4edd-81a6-81750fb45d17 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.585820 Jun 27 21:17:00.580881 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 84/177] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:59 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:00.991586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-b5767fb2-f6df-4621-8841-023d21080cda req-23b45787-e36a-48a0-a49a-c600f41c4a10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b28fb7f-5684-4656-bd7c-b6d7d15790b1", "tag": "c722f6d7-3bed-4343-ad5e-1c84bfc3ac4e"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:01.011181 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-b5767fb2-f6df-4621-8841-023d21080cda req-23b45787-e36a-48a0-a49a-c600f41c4a10 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:01.011851 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-b5767fb2-f6df-4621-8841-023d21080cda req-23b45787-e36a-48a0-a49a-c600f41c4a10 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:01.041332 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-b5767fb2-f6df-4621-8841-023d21080cda req-23b45787-e36a-48a0-a49a-c600f41c4a10 service nova] Creating event network-changed:c722f6d7-3bed-4343-ad5e-1c84bfc3ac4e for instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 on hv-cinder-84773 Jun 27 21:17:01.050159 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-b5767fb2-f6df-4621-8841-023d21080cda req-23b45787-e36a-48a0-a49a-c600f41c4a10 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062613 Jun 27 21:17:01.050790 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 94/178] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:01.588472 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1bb82989-4882-41bc-97cb-a7c56ced30fd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:01.589084 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1bb82989-4882-41bc-97cb-a7c56ced30fd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:01.595589 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1bb82989-4882-41bc-97cb-a7c56ced30fd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:01.596558 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1bb82989-4882-41bc-97cb-a7c56ced30fd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:01.597438 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1bb82989-4882-41bc-97cb-a7c56ced30fd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:01.598100 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1bb82989-4882-41bc-97cb-a7c56ced30fd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:01.766459 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1bb82989-4882-41bc-97cb-a7c56ced30fd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:01.771088 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:01.778042 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1bb82989-4882-41bc-97cb-a7c56ced30fd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.194378 Jun 27 21:17:01.779500 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 85/179] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:01 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:02.799421 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4c5eaa39-e6de-49b4-8eff-65cd65c4e066 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:02.800892 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4c5eaa39-e6de-49b4-8eff-65cd65c4e066 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:02.807691 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4c5eaa39-e6de-49b4-8eff-65cd65c4e066 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:02.808209 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4c5eaa39-e6de-49b4-8eff-65cd65c4e066 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:02.808902 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4c5eaa39-e6de-49b4-8eff-65cd65c4e066 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:02.809424 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4c5eaa39-e6de-49b4-8eff-65cd65c4e066 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:02.964485 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4c5eaa39-e6de-49b4-8eff-65cd65c4e066 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:02.975059 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4c5eaa39-e6de-49b4-8eff-65cd65c4e066 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.181925 Jun 27 21:17:02.976310 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 95/180] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:02 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:17:03.995468 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ca3afea1-3fc4-4bc4-9e31-47c9fde12683 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:03.997079 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ca3afea1-3fc4-4bc4-9e31-47c9fde12683 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:04.005953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ca3afea1-3fc4-4bc4-9e31-47c9fde12683 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:04.006393 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ca3afea1-3fc4-4bc4-9e31-47c9fde12683 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:04.007360 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ca3afea1-3fc4-4bc4-9e31-47c9fde12683 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:04.007952 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ca3afea1-3fc4-4bc4-9e31-47c9fde12683 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:04.168068 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ca3afea1-3fc4-4bc4-9e31-47c9fde12683 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:04.179009 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ca3afea1-3fc4-4bc4-9e31-47c9fde12683 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.189646 Jun 27 21:17:04.179795 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 86/181] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:03 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:05.197690 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-94e79395-963e-4330-aa10-e2393d56ece8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:05.198525 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-94e79395-963e-4330-aa10-e2393d56ece8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:05.207564 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-94e79395-963e-4330-aa10-e2393d56ece8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:05.208009 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-94e79395-963e-4330-aa10-e2393d56ece8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:05.208772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-94e79395-963e-4330-aa10-e2393d56ece8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:05.209234 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-94e79395-963e-4330-aa10-e2393d56ece8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:05.383937 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-94e79395-963e-4330-aa10-e2393d56ece8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:05.392502 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-94e79395-963e-4330-aa10-e2393d56ece8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.198706 Jun 27 21:17:05.393453 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 96/182] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:05 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:06.411694 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e049844e-eb60-4b96-9383-396cfb2ed6b3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:06.412295 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e049844e-eb60-4b96-9383-396cfb2ed6b3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:06.419357 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e049844e-eb60-4b96-9383-396cfb2ed6b3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:06.419796 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e049844e-eb60-4b96-9383-396cfb2ed6b3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:06.420546 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e049844e-eb60-4b96-9383-396cfb2ed6b3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:06.421007 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e049844e-eb60-4b96-9383-396cfb2ed6b3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:06.562621 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e049844e-eb60-4b96-9383-396cfb2ed6b3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:06.570401 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e049844e-eb60-4b96-9383-396cfb2ed6b3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.163328 Jun 27 21:17:06.571067 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 87/183] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:06 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:07.587275 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b0988d41-0b16-4ee6-9033-05372d9a0d55 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:07.588199 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b0988d41-0b16-4ee6-9033-05372d9a0d55 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:07.595174 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b0988d41-0b16-4ee6-9033-05372d9a0d55 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:07.595616 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b0988d41-0b16-4ee6-9033-05372d9a0d55 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:07.596374 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b0988d41-0b16-4ee6-9033-05372d9a0d55 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:07.596801 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b0988d41-0b16-4ee6-9033-05372d9a0d55 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:07.730627 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b0988d41-0b16-4ee6-9033-05372d9a0d55 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:07.738766 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b0988d41-0b16-4ee6-9033-05372d9a0d55 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.155557 Jun 27 21:17:07.739346 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 97/184] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:07 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:08.034114 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-140d9b30-5b26-4310-adf2-1a2e91f90a46 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:08.034791 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-140d9b30-5b26-4310-adf2-1a2e91f90a46 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:08.042027 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-140d9b30-5b26-4310-adf2-1a2e91f90a46 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:08.042476 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-140d9b30-5b26-4310-adf2-1a2e91f90a46 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:08.043264 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-140d9b30-5b26-4310-adf2-1a2e91f90a46 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:08.043721 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-140d9b30-5b26-4310-adf2-1a2e91f90a46 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:08.075711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-140d9b30-5b26-4310-adf2-1a2e91f90a46 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:17:08.187743 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-140d9b30-5b26-4310-adf2-1a2e91f90a46 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 204 len: 0 microversion: 2.1 time: 0.166934 Jun 27 21:17:08.188436 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 88/185] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:17:08 2022] DELETE /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:17:08.201339 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e22955bd-a7f2-42b2-8b55-fee60b0d5185 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:08.201339 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e22955bd-a7f2-42b2-8b55-fee60b0d5185 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:08.205227 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e22955bd-a7f2-42b2-8b55-fee60b0d5185 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:08.206303 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e22955bd-a7f2-42b2-8b55-fee60b0d5185 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:08.206445 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e22955bd-a7f2-42b2-8b55-fee60b0d5185 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:08.206972 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e22955bd-a7f2-42b2-8b55-fee60b0d5185 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:08.363125 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e22955bd-a7f2-42b2-8b55-fee60b0d5185 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:08.371684 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e22955bd-a7f2-42b2-8b55-fee60b0d5185 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1554 microversion: 2.1 time: 0.178478 Jun 27 21:17:08.372254 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 98/186] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:08 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:08.756005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d57c5480-f78b-48b7-98f9-de42928eb744 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:08.756701 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d57c5480-f78b-48b7-98f9-de42928eb744 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:08.764116 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d57c5480-f78b-48b7-98f9-de42928eb744 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:08.764558 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d57c5480-f78b-48b7-98f9-de42928eb744 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:08.765422 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d57c5480-f78b-48b7-98f9-de42928eb744 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:08.765839 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d57c5480-f78b-48b7-98f9-de42928eb744 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:08.929643 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d57c5480-f78b-48b7-98f9-de42928eb744 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:08.941081 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d57c5480-f78b-48b7-98f9-de42928eb744 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.189330 Jun 27 21:17:08.941701 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 89/187] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:08 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:09.389535 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6dd40408-f880-40c5-b7b4-9c0e5e85bf61 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:09.390188 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6dd40408-f880-40c5-b7b4-9c0e5e85bf61 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:09.398108 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6dd40408-f880-40c5-b7b4-9c0e5e85bf61 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:09.398689 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6dd40408-f880-40c5-b7b4-9c0e5e85bf61 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:09.399884 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6dd40408-f880-40c5-b7b4-9c0e5e85bf61 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:09.399884 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6dd40408-f880-40c5-b7b4-9c0e5e85bf61 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:09.548114 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-6dd40408-f880-40c5-b7b4-9c0e5e85bf61 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:09.557374 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6dd40408-f880-40c5-b7b4-9c0e5e85bf61 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1554 microversion: 2.1 time: 0.172287 Jun 27 21:17:09.558024 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 99/188] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:09 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:09.959940 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d973bd9c-a844-48f1-ac51-ad74c123b483 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:09.960531 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d973bd9c-a844-48f1-ac51-ad74c123b483 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:09.968567 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d973bd9c-a844-48f1-ac51-ad74c123b483 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:09.969210 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d973bd9c-a844-48f1-ac51-ad74c123b483 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:09.970210 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d973bd9c-a844-48f1-ac51-ad74c123b483 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:09.970771 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d973bd9c-a844-48f1-ac51-ad74c123b483 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:10.112956 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d973bd9c-a844-48f1-ac51-ad74c123b483 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:10.121313 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d973bd9c-a844-48f1-ac51-ad74c123b483 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.165371 Jun 27 21:17:10.121966 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 90/189] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:09 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:17:10.577820 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1f790d52-1595-43ec-b350-aaa5a117e9fa tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:10.578551 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1f790d52-1595-43ec-b350-aaa5a117e9fa tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:10.581540 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=90 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:10.589621 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1f790d52-1595-43ec-b350-aaa5a117e9fa tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:10.590068 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1f790d52-1595-43ec-b350-aaa5a117e9fa tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:10.590978 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1f790d52-1595-43ec-b350-aaa5a117e9fa tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:10.591453 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1f790d52-1595-43ec-b350-aaa5a117e9fa tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:10.752265 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1f790d52-1595-43ec-b350-aaa5a117e9fa tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:10.762167 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1f790d52-1595-43ec-b350-aaa5a117e9fa tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1554 microversion: 2.1 time: 0.190155 Jun 27 21:17:10.762779 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 100/190] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:10 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1554 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:11.139873 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f8a3190e-869a-4358-8b68-445b83e7be04 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:11.140443 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f8a3190e-869a-4358-8b68-445b83e7be04 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:11.147251 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f8a3190e-869a-4358-8b68-445b83e7be04 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:11.147700 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f8a3190e-869a-4358-8b68-445b83e7be04 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:11.148496 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f8a3190e-869a-4358-8b68-445b83e7be04 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:11.148953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f8a3190e-869a-4358-8b68-445b83e7be04 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:11.287372 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f8a3190e-869a-4358-8b68-445b83e7be04 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:11.295515 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f8a3190e-869a-4358-8b68-445b83e7be04 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.159611 Jun 27 21:17:11.296096 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 91/191] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:11 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:11.779941 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e1c0c1dd-34c1-4da4-9ae7-4bd682bc2383 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:11.780613 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e1c0c1dd-34c1-4da4-9ae7-4bd682bc2383 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:11.787481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e1c0c1dd-34c1-4da4-9ae7-4bd682bc2383 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:11.787925 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e1c0c1dd-34c1-4da4-9ae7-4bd682bc2383 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:11.788669 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e1c0c1dd-34c1-4da4-9ae7-4bd682bc2383 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:11.789167 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e1c0c1dd-34c1-4da4-9ae7-4bd682bc2383 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:11.926637 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e1c0c1dd-34c1-4da4-9ae7-4bd682bc2383 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:11.935415 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e1c0c1dd-34c1-4da4-9ae7-4bd682bc2383 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1554 microversion: 2.1 time: 0.159512 Jun 27 21:17:11.936021 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 101/192] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:11 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:17:12.313247 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-59d89233-6f2e-4b9f-a01c-a54679e9f9fe tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:12.313851 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-59d89233-6f2e-4b9f-a01c-a54679e9f9fe tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:12.320650 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-59d89233-6f2e-4b9f-a01c-a54679e9f9fe tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:12.321141 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-59d89233-6f2e-4b9f-a01c-a54679e9f9fe tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:12.321952 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-59d89233-6f2e-4b9f-a01c-a54679e9f9fe tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:12.322402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-59d89233-6f2e-4b9f-a01c-a54679e9f9fe tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:12.466088 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-59d89233-6f2e-4b9f-a01c-a54679e9f9fe tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:12.474257 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-59d89233-6f2e-4b9f-a01c-a54679e9f9fe tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.165105 Jun 27 21:17:12.474856 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 92/193] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:12 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:12.951969 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-316933d1-4566-4e99-bc42-ae1ea8144601 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:12.952694 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-316933d1-4566-4e99-bc42-ae1ea8144601 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:12.959984 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-316933d1-4566-4e99-bc42-ae1ea8144601 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:12.960430 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-316933d1-4566-4e99-bc42-ae1ea8144601 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:12.961325 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-316933d1-4566-4e99-bc42-ae1ea8144601 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:12.961726 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-316933d1-4566-4e99-bc42-ae1ea8144601 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:13.097660 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-316933d1-4566-4e99-bc42-ae1ea8144601 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:13.106365 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-316933d1-4566-4e99-bc42-ae1ea8144601 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1554 microversion: 2.1 time: 0.158262 Jun 27 21:17:13.107216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 102/194] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:12 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:13.492039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3d88ceac-6830-4da5-8585-e1590ec6512e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:13.492615 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3d88ceac-6830-4da5-8585-e1590ec6512e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:13.499443 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d88ceac-6830-4da5-8585-e1590ec6512e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:13.499910 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d88ceac-6830-4da5-8585-e1590ec6512e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:13.500676 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d88ceac-6830-4da5-8585-e1590ec6512e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:13.501137 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d88ceac-6830-4da5-8585-e1590ec6512e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:13.645267 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3d88ceac-6830-4da5-8585-e1590ec6512e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:13.654625 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3d88ceac-6830-4da5-8585-e1590ec6512e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.166477 Jun 27 21:17:13.655201 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 93/195] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:13 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:14.124223 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ef9d3aaf-1902-40dc-9549-1cbba29ab135 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:14.124772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ef9d3aaf-1902-40dc-9549-1cbba29ab135 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:14.131869 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ef9d3aaf-1902-40dc-9549-1cbba29ab135 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:14.132312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ef9d3aaf-1902-40dc-9549-1cbba29ab135 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:14.133119 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ef9d3aaf-1902-40dc-9549-1cbba29ab135 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:14.133551 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ef9d3aaf-1902-40dc-9549-1cbba29ab135 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:14.295082 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ef9d3aaf-1902-40dc-9549-1cbba29ab135 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:14.304224 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ef9d3aaf-1902-40dc-9549-1cbba29ab135 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1554 microversion: 2.1 time: 0.184212 Jun 27 21:17:14.305182 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 103/196] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:14 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1554 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:14.672431 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e3a5f7b4-7ff1-498a-b8dd-f5e8bcc79617 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:14.673087 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e3a5f7b4-7ff1-498a-b8dd-f5e8bcc79617 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:14.679918 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3a5f7b4-7ff1-498a-b8dd-f5e8bcc79617 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:14.680461 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3a5f7b4-7ff1-498a-b8dd-f5e8bcc79617 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:14.681274 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3a5f7b4-7ff1-498a-b8dd-f5e8bcc79617 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:14.681851 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3a5f7b4-7ff1-498a-b8dd-f5e8bcc79617 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:14.851004 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e3a5f7b4-7ff1-498a-b8dd-f5e8bcc79617 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:14.860474 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e3a5f7b4-7ff1-498a-b8dd-f5e8bcc79617 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.192250 Jun 27 21:17:14.861109 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 94/197] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:14 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:15.322314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9530ae84-ce5a-4f4f-a587-4b49fbfecb8b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:15.323041 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9530ae84-ce5a-4f4f-a587-4b49fbfecb8b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:15.330119 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9530ae84-ce5a-4f4f-a587-4b49fbfecb8b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:15.330563 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9530ae84-ce5a-4f4f-a587-4b49fbfecb8b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:15.331412 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9530ae84-ce5a-4f4f-a587-4b49fbfecb8b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:15.331875 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9530ae84-ce5a-4f4f-a587-4b49fbfecb8b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:15.484173 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9530ae84-ce5a-4f4f-a587-4b49fbfecb8b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:15.493441 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9530ae84-ce5a-4f4f-a587-4b49fbfecb8b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1554 microversion: 2.1 time: 0.174960 Jun 27 21:17:15.494052 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 104/198] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:15 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:15.877905 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2feaf284-cdc6-4831-90c3-37f7d91831c1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:15.878538 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2feaf284-cdc6-4831-90c3-37f7d91831c1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:15.885118 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2feaf284-cdc6-4831-90c3-37f7d91831c1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:15.885557 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2feaf284-cdc6-4831-90c3-37f7d91831c1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:15.886311 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2feaf284-cdc6-4831-90c3-37f7d91831c1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:15.886738 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2feaf284-cdc6-4831-90c3-37f7d91831c1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:16.021693 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2feaf284-cdc6-4831-90c3-37f7d91831c1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:16.030629 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2feaf284-cdc6-4831-90c3-37f7d91831c1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.156884 Jun 27 21:17:16.031199 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 95/199] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:15 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:16.511899 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7a057716-10f5-4514-8084-39952d8dd69b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:16.512622 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7a057716-10f5-4514-8084-39952d8dd69b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:16.519445 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7a057716-10f5-4514-8084-39952d8dd69b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:16.520051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7a057716-10f5-4514-8084-39952d8dd69b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:16.521204 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7a057716-10f5-4514-8084-39952d8dd69b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:16.521747 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7a057716-10f5-4514-8084-39952d8dd69b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:16.524866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:16.725846 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7a057716-10f5-4514-8084-39952d8dd69b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:16.735706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7a057716-10f5-4514-8084-39952d8dd69b tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1554 microversion: 2.1 time: 0.228319 Jun 27 21:17:16.745608 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 105/200] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:16 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1554 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:16.836874 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-6fe53378-4886-4580-b2b2-d647be850645 req-7c57612c-0bc8-400a-827f-d2885b511f55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfecef68-0f46-4744-8dc0-d721f692710b", "name": "network-vif-deleted", "tag": "baa095fe-f218-45c8-b731-2f6078fc2222"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:16.846130 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-6fe53378-4886-4580-b2b2-d647be850645 req-7c57612c-0bc8-400a-827f-d2885b511f55 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:16.846579 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-6fe53378-4886-4580-b2b2-d647be850645 req-7c57612c-0bc8-400a-827f-d2885b511f55 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:16.859109 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-6fe53378-4886-4580-b2b2-d647be850645 req-7c57612c-0bc8-400a-827f-d2885b511f55 service nova] Creating event network-vif-deleted:baa095fe-f218-45c8-b731-2f6078fc2222 for instance cfecef68-0f46-4744-8dc0-d721f692710b on hv-cinder-84773 Jun 27 21:17:16.873299 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-6fe53378-4886-4580-b2b2-d647be850645 req-7c57612c-0bc8-400a-827f-d2885b511f55 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040094 Jun 27 21:17:16.873952 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 96/201] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:17.048447 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-59b09a1f-5939-4cd1-a87e-a28be196798a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:17.049026 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-59b09a1f-5939-4cd1-a87e-a28be196798a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:17.056228 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-59b09a1f-5939-4cd1-a87e-a28be196798a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:17.056743 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-59b09a1f-5939-4cd1-a87e-a28be196798a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:17.057759 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-59b09a1f-5939-4cd1-a87e-a28be196798a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:17.058194 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-59b09a1f-5939-4cd1-a87e-a28be196798a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:17.191451 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-59b09a1f-5939-4cd1-a87e-a28be196798a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:17.199268 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-59b09a1f-5939-4cd1-a87e-a28be196798a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.154938 Jun 27 21:17:17.199833 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 106/202] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:17 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:17.752974 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-26edee26-d952-4f18-9cdb-d2680fbf51db tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:17.753610 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-26edee26-d952-4f18-9cdb-d2680fbf51db tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:17.761956 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-26edee26-d952-4f18-9cdb-d2680fbf51db tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:17.762414 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-26edee26-d952-4f18-9cdb-d2680fbf51db tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:17.763293 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-26edee26-d952-4f18-9cdb-d2680fbf51db tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:17.763919 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-26edee26-d952-4f18-9cdb-d2680fbf51db tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:17.837009 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-26edee26-d952-4f18-9cdb-d2680fbf51db tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0e1b60083640bd89b9b4287fdb9d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e58fc8b6e14185b4409884a5701316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:17.849105 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-26edee26-d952-4f18-9cdb-d2680fbf51db tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 200 len: 1346 microversion: 2.1 time: 0.100273 Jun 27 21:17:17.850354 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 97/203] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:17 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 1346 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:17:18.217041 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c8b026b7-522d-4219-8a71-b22f4aa03aea tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:18.217765 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c8b026b7-522d-4219-8a71-b22f4aa03aea tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:18.224848 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c8b026b7-522d-4219-8a71-b22f4aa03aea tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:18.225435 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c8b026b7-522d-4219-8a71-b22f4aa03aea tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:18.226253 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c8b026b7-522d-4219-8a71-b22f4aa03aea tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:18.226902 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c8b026b7-522d-4219-8a71-b22f4aa03aea tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:18.421415 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c8b026b7-522d-4219-8a71-b22f4aa03aea tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:18.429739 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c8b026b7-522d-4219-8a71-b22f4aa03aea tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.217916 Jun 27 21:17:18.430647 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 107/204] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:18 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:18.867807 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-098ae246-887d-4442-8761-1ac1776d3a9a tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:18.868522 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-098ae246-887d-4442-8761-1ac1776d3a9a tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:18.875727 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-098ae246-887d-4442-8761-1ac1776d3a9a tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:18.877163 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-098ae246-887d-4442-8761-1ac1776d3a9a tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:18.878750 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-098ae246-887d-4442-8761-1ac1776d3a9a tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:18.879400 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-098ae246-887d-4442-8761-1ac1776d3a9a tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:18.896123 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-098ae246-887d-4442-8761-1ac1776d3a9a tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] HTTP exception thrown: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. Jun 27 21:17:18.902154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-098ae246-887d-4442-8761-1ac1776d3a9a tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Request method failure captured: Jun 27 21:17:18.902154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b HTTP/1.1 Jun 27 21:17:18.902154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:17:18.902154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:17:18.902154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:17:18.902154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:17:18.902154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:17:18.902154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:17:18.902154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:17:18.902154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:17:18.902154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh4Ym6c7sTifbp19iFWAUAsXUfcIIgGV1gtBAITOixY2GC1U8fdKmFTkj_bSNmCn8SdmWwjGYjW-PO_sMsESn0odWAYMYq0ZNzHvhqzc5JqPg6IgzzzIqrJiHucRT2ZAcYOJQNU_srSwhn7Tq9nFFZptMOlfl6IRlGSBOaR6OfCDuQQ Jun 27 21:17:18.902154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:17:18.902154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:17:18.902154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:17:18.902154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:17:18.902154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:17:18.902154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:17:18.902154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: a2e58fc8b6e14185b4409884a5701316 Jun 27 21:17:18.902154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-DeleteServersTestJSON-1996827256 Jun 27 21:17:18.902154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:17:18.902154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:17:18.903500 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a2e58fc8b6e14185b4409884a5701316", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a2e58fc8b6e14185b4409884a5701316"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a2e58fc8b6e14185b4409884a5701316"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a2e58fc8b6e14185b4409884a5701316"}]}] Jun 27 21:17:18.903500 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-DeleteServersTestJSON-1996827256 Jun 27 21:17:18.903500 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: a2e58fc8b6e14185b4409884a5701316 Jun 27 21:17:18.903500 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-DeleteServersTestJSON-1996827256 Jun 27 21:17:18.903500 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-DeleteServersTestJSON-1996827256-project Jun 27 21:17:18.903500 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:17:18.903500 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:17:18.903500 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: db0e1b60083640bd89b9b4287fdb9d28 Jun 27 21:17:18.903500 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-DeleteServersTestJSON-1996827256-project Jun 27 21:17:18.903500 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:17:18.903500 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. Jun 27 21:17:18.903500 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': 'cfecef68-0f46-4744-8dc0-d721f692710b'} Jun 27 21:17:18.904258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:17:18.904258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:18.904258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:17:18.904258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:17:18.904258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:17:18.904258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:17:18.904258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:17:18.904258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:17:18.904258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:17:18.904258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:17:18.904258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. Jun 27 21:17:18.904258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:18.904258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:18.904258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:18.904258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:18.904258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:18.904258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:18.904258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:17:18.904258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:17:18.904258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:17:18.905581 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:17:18.905581 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:17:18.905581 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:17:18.905581 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:17:18.905581 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:17:18.905581 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:17:18.905581 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:17:18.905581 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. Jun 27 21:17:18.905581 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:18.905581 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:18.905581 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:18.905581 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:18.905581 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:18.905581 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:18.905581 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:17:18.905581 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:17:18.905581 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. Jun 27 21:17:18.905581 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:18.907980 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-098ae246-887d-4442-8761-1ac1776d3a9a tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Returning 404 to user: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:17:18.909308 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-098ae246-887d-4442-8761-1ac1776d3a9a tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 404 len: 111 microversion: 2.1 time: 0.045491 Jun 27 21:17:18.913521 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 98/205] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:18 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:17:19.058821 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-46a3e539-610f-45e4-a7fe-2f4222456ccf tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:19.059888 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-46a3e539-610f-45e4-a7fe-2f4222456ccf tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:19.066929 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-46a3e539-610f-45e4-a7fe-2f4222456ccf tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:19.067589 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-46a3e539-610f-45e4-a7fe-2f4222456ccf tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:19.068681 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-46a3e539-610f-45e4-a7fe-2f4222456ccf tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:19.069315 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-46a3e539-610f-45e4-a7fe-2f4222456ccf tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:19.271929 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-46a3e539-610f-45e4-a7fe-2f4222456ccf tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] HTTP exception thrown: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. Jun 27 21:17:19.281623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-46a3e539-610f-45e4-a7fe-2f4222456ccf tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Request method failure captured: Jun 27 21:17:19.281623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b/os-volume_attachments HTTP/1.1 Jun 27 21:17:19.281623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:17:19.281623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:17:19.281623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:17:19.281623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:17:19.281623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:17:19.281623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:17:19.281623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:17:19.281623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:17:19.281623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh4Ym6c7sTifbp19iFWAUAsXUfcIIgGV1gtBAITOixY2GC1U8fdKmFTkj_bSNmCn8SdmWwjGYjW-PO_sMsESn0odWAYMYq0ZNzHvhqzc5JqPg6IgzzzIqrJiHucRT2ZAcYOJQNU_srSwhn7Tq9nFFZptMOlfl6IRlGSBOaR6OfCDuQQ Jun 27 21:17:19.281623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:17:19.281623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:17:19.281623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:17:19.281623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:17:19.281623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:17:19.281623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:17:19.281623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: a2e58fc8b6e14185b4409884a5701316 Jun 27 21:17:19.281623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-DeleteServersTestJSON-1996827256 Jun 27 21:17:19.281623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:17:19.281623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:17:19.283098 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a2e58fc8b6e14185b4409884a5701316", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a2e58fc8b6e14185b4409884a5701316"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a2e58fc8b6e14185b4409884a5701316"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a2e58fc8b6e14185b4409884a5701316"}]}] Jun 27 21:17:19.283098 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-DeleteServersTestJSON-1996827256 Jun 27 21:17:19.283098 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: a2e58fc8b6e14185b4409884a5701316 Jun 27 21:17:19.283098 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-DeleteServersTestJSON-1996827256 Jun 27 21:17:19.283098 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-DeleteServersTestJSON-1996827256-project Jun 27 21:17:19.283098 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:17:19.283098 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:17:19.283098 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: db0e1b60083640bd89b9b4287fdb9d28 Jun 27 21:17:19.283098 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-DeleteServersTestJSON-1996827256-project Jun 27 21:17:19.283098 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: > Jun 27 21:17:19.283098 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. Jun 27 21:17:19.283098 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'server_id': 'cfecef68-0f46-4744-8dc0-d721f692710b'} Jun 27 21:17:19.284172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:17:19.284172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:19.284172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:17:19.284172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:17:19.284172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:17:19.284172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:17:19.284172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:17:19.284172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:17:19.284172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:17:19.284172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:17:19.284172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. Jun 27 21:17:19.284172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:19.284172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:19.284172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:19.284172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:19.284172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:19.284172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:19.284172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:17:19.284172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:17:19.284172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:17:19.285446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:17:19.285446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 27 21:17:19.285446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 21:17:19.285446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 27 21:17:19.285446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 21:17:19.285446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 27 21:17:19.285446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 27 21:17:19.285446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:17:19.285446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:17:19.285446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. Jun 27 21:17:19.285446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:19.285446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:19.285446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:19.285446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:19.285446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:19.285446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:19.285446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:17:19.285446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:17:19.285446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. Jun 27 21:17:19.285446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:19.286740 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-46a3e539-610f-45e4-a7fe-2f4222456ccf tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Returning 404 to user: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:17:19.286740 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-46a3e539-610f-45e4-a7fe-2f4222456ccf tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.229042 Jun 27 21:17:19.286740 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 108/206] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 27 21:17:19 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b/os-volume_attachments => generated 111 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:17:19.449487 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-383dc965-231f-4419-8501-4d1f74f0eed8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:19.450239 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-383dc965-231f-4419-8501-4d1f74f0eed8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:19.459629 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-383dc965-231f-4419-8501-4d1f74f0eed8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:19.459629 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-383dc965-231f-4419-8501-4d1f74f0eed8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:19.460870 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-383dc965-231f-4419-8501-4d1f74f0eed8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:19.465515 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-383dc965-231f-4419-8501-4d1f74f0eed8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:19.669536 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-383dc965-231f-4419-8501-4d1f74f0eed8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:19.679548 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-383dc965-231f-4419-8501-4d1f74f0eed8 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.234784 Jun 27 21:17:19.680594 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 99/207] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:19 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:20.655148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e9afdf02-5215-4637-886a-91e12e888d51 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:20.655745 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e9afdf02-5215-4637-886a-91e12e888d51 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:20.663328 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e9afdf02-5215-4637-886a-91e12e888d51 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:20.663771 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e9afdf02-5215-4637-886a-91e12e888d51 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:20.664578 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e9afdf02-5215-4637-886a-91e12e888d51 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:20.665358 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e9afdf02-5215-4637-886a-91e12e888d51 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:20.680845 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-e9afdf02-5215-4637-886a-91e12e888d51 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] HTTP exception thrown: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. Jun 27 21:17:20.683069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e9afdf02-5215-4637-886a-91e12e888d51 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Request method failure captured: Jun 27 21:17:20.683069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: DELETE /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b HTTP/1.1 Jun 27 21:17:20.683069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:17:20.683069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:17:20.683069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:17:20.683069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:17:20.683069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:17:20.683069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:17:20.683069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:17:20.683069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:17:20.683069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh4Ym6c7sTifbp19iFWAUAsXUfcIIgGV1gtBAITOixY2GC1U8fdKmFTkj_bSNmCn8SdmWwjGYjW-PO_sMsESn0odWAYMYq0ZNzHvhqzc5JqPg6IgzzzIqrJiHucRT2ZAcYOJQNU_srSwhn7Tq9nFFZptMOlfl6IRlGSBOaR6OfCDuQQ Jun 27 21:17:20.683069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:17:20.683069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:17:20.683069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:17:20.683069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:17:20.683069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:17:20.683069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:17:20.683069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: a2e58fc8b6e14185b4409884a5701316 Jun 27 21:17:20.683069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-DeleteServersTestJSON-1996827256 Jun 27 21:17:20.683069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:17:20.683069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:17:20.684468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a2e58fc8b6e14185b4409884a5701316", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a2e58fc8b6e14185b4409884a5701316"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a2e58fc8b6e14185b4409884a5701316"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a2e58fc8b6e14185b4409884a5701316"}]}] Jun 27 21:17:20.684468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-DeleteServersTestJSON-1996827256 Jun 27 21:17:20.684468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: a2e58fc8b6e14185b4409884a5701316 Jun 27 21:17:20.684468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-DeleteServersTestJSON-1996827256 Jun 27 21:17:20.684468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-DeleteServersTestJSON-1996827256-project Jun 27 21:17:20.684468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:17:20.684468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:17:20.684468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: db0e1b60083640bd89b9b4287fdb9d28 Jun 27 21:17:20.684468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-DeleteServersTestJSON-1996827256-project Jun 27 21:17:20.684468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: > Jun 27 21:17:20.684468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. Jun 27 21:17:20.684468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'id': 'cfecef68-0f46-4744-8dc0-d721f692710b'} Jun 27 21:17:20.685317 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:17:20.685317 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:20.685317 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:17:20.685317 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:17:20.685317 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:17:20.685317 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:17:20.685317 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:17:20.685317 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:17:20.685317 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:17:20.685317 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:17:20.685317 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. Jun 27 21:17:20.685317 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:20.685317 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:20.685317 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:20.685317 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:20.685317 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:20.685317 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:20.685317 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:17:20.685317 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:17:20.685317 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:17:20.686719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:17:20.686719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 21:17:20.686719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 21:17:20.686719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 21:17:20.686719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 21:17:20.686719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:17:20.686719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:17:20.686719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:17:20.686719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:17:20.686719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. Jun 27 21:17:20.686719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:20.686719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:20.686719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:20.686719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:20.686719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:20.686719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:20.686719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:17:20.686719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:17:20.686719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. Jun 27 21:17:20.686719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:20.688041 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e9afdf02-5215-4637-886a-91e12e888d51 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Returning 404 to user: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:17:20.688041 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e9afdf02-5215-4637-886a-91e12e888d51 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 404 len: 111 microversion: 2.1 time: 0.033446 Jun 27 21:17:20.688041 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 109/208] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:17:20 2022] DELETE /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:17:20.693955 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d84ac9fc-6b6d-42cb-ac98-720957cd9b52 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:20.694753 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d84ac9fc-6b6d-42cb-ac98-720957cd9b52 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] [instance: cfecef68-0f46-4744-8dc0-d721f692710b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:20.702025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d84ac9fc-6b6d-42cb-ac98-720957cd9b52 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:20.702252 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5863c75b-b845-47e5-ab06-6bf23ab13636 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:20.702750 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-5863c75b-b845-47e5-ab06-6bf23ab13636 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:20.702884 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d84ac9fc-6b6d-42cb-ac98-720957cd9b52 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:20.703596 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d84ac9fc-6b6d-42cb-ac98-720957cd9b52 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:20.704005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d84ac9fc-6b6d-42cb-ac98-720957cd9b52 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:20.708839 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5863c75b-b845-47e5-ab06-6bf23ab13636 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:20.709340 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5863c75b-b845-47e5-ab06-6bf23ab13636 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:20.710256 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5863c75b-b845-47e5-ab06-6bf23ab13636 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:20.710720 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5863c75b-b845-47e5-ab06-6bf23ab13636 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:20.721831 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-d84ac9fc-6b6d-42cb-ac98-720957cd9b52 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] HTTP exception thrown: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. Jun 27 21:17:20.723654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d84ac9fc-6b6d-42cb-ac98-720957cd9b52 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Request method failure captured: Jun 27 21:17:20.723654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b HTTP/1.1 Jun 27 21:17:20.723654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:17:20.723654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:17:20.723654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:17:20.723654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:17:20.723654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:17:20.723654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:17:20.723654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:17:20.723654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:17:20.723654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh4Ym6c7sTifbp19iFWAUAsXUfcIIgGV1gtBAITOixY2GC1U8fdKmFTkj_bSNmCn8SdmWwjGYjW-PO_sMsESn0odWAYMYq0ZNzHvhqzc5JqPg6IgzzzIqrJiHucRT2ZAcYOJQNU_srSwhn7Tq9nFFZptMOlfl6IRlGSBOaR6OfCDuQQ Jun 27 21:17:20.723654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:17:20.723654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:17:20.723654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:17:20.723654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:17:20.723654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:17:20.723654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:17:20.723654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: a2e58fc8b6e14185b4409884a5701316 Jun 27 21:17:20.723654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-DeleteServersTestJSON-1996827256 Jun 27 21:17:20.723654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:17:20.723654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:17:20.725096 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a2e58fc8b6e14185b4409884a5701316", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a2e58fc8b6e14185b4409884a5701316"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a2e58fc8b6e14185b4409884a5701316"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a2e58fc8b6e14185b4409884a5701316"}]}] Jun 27 21:17:20.725096 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-DeleteServersTestJSON-1996827256 Jun 27 21:17:20.725096 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: a2e58fc8b6e14185b4409884a5701316 Jun 27 21:17:20.725096 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-DeleteServersTestJSON-1996827256 Jun 27 21:17:20.725096 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-DeleteServersTestJSON-1996827256-project Jun 27 21:17:20.725096 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:17:20.725096 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:17:20.725096 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: db0e1b60083640bd89b9b4287fdb9d28 Jun 27 21:17:20.725096 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-DeleteServersTestJSON-1996827256-project Jun 27 21:17:20.725096 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:17:20.725096 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. Jun 27 21:17:20.725096 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': 'cfecef68-0f46-4744-8dc0-d721f692710b'} Jun 27 21:17:20.725772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:17:20.725772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:20.725772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:17:20.725772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:17:20.725772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:17:20.725772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:17:20.725772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:17:20.725772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:17:20.725772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:17:20.725772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:17:20.725772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. Jun 27 21:17:20.725772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:20.725772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:20.725772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:20.725772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:20.725772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:20.725772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:20.725772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:17:20.725772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:17:20.725772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:17:20.727323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:17:20.727323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:17:20.727323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:17:20.727323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:17:20.727323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:17:20.727323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:17:20.727323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:17:20.727323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. Jun 27 21:17:20.727323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:20.727323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:20.727323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:20.727323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:20.727323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:20.727323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:20.727323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:17:20.727323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:17:20.727323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. Jun 27 21:17:20.727323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:20.729053 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d84ac9fc-6b6d-42cb-ac98-720957cd9b52 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] Returning 404 to user: Instance cfecef68-0f46-4744-8dc0-d721f692710b could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:17:20.729053 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d84ac9fc-6b6d-42cb-ac98-720957cd9b52 tempest-DeleteServersTestJSON-1996827256 tempest-DeleteServersTestJSON-1996827256-project] 10.222.0.13 "GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b" status: 404 len: 111 microversion: 2.1 time: 0.035883 Jun 27 21:17:20.729053 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 100/209] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:20 2022] GET /compute/v2.1/servers/cfecef68-0f46-4744-8dc0-d721f692710b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:17:21.223301 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5863c75b-b845-47e5-ab06-6bf23ab13636 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:21.233656 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5863c75b-b845-47e5-ab06-6bf23ab13636 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.535579 Jun 27 21:17:21.234436 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 110/210] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:20 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:22.251682 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e7d6f96e-3901-49d1-8b94-de2b45190270 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:22.252297 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e7d6f96e-3901-49d1-8b94-de2b45190270 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:22.256198 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:22.264317 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e7d6f96e-3901-49d1-8b94-de2b45190270 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:22.265974 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e7d6f96e-3901-49d1-8b94-de2b45190270 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:22.266994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e7d6f96e-3901-49d1-8b94-de2b45190270 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:22.267550 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e7d6f96e-3901-49d1-8b94-de2b45190270 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:22.433410 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e7d6f96e-3901-49d1-8b94-de2b45190270 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:22.442063 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e7d6f96e-3901-49d1-8b94-de2b45190270 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.194826 Jun 27 21:17:22.442764 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 101/211] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:22 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:23.461284 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6f31f0c3-a5d0-4267-867a-3a24b6cd782b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:23.461822 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6f31f0c3-a5d0-4267-867a-3a24b6cd782b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:23.469716 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6f31f0c3-a5d0-4267-867a-3a24b6cd782b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:23.470166 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6f31f0c3-a5d0-4267-867a-3a24b6cd782b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:23.470942 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6f31f0c3-a5d0-4267-867a-3a24b6cd782b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:23.471377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6f31f0c3-a5d0-4267-867a-3a24b6cd782b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:23.724621 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-6f31f0c3-a5d0-4267-867a-3a24b6cd782b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:23.734860 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6f31f0c3-a5d0-4267-867a-3a24b6cd782b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.277409 Jun 27 21:17:23.735464 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 111/212] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:23 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:24.753199 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0e3859b9-18bb-4477-857d-7e319c45dd26 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:24.753794 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0e3859b9-18bb-4477-857d-7e319c45dd26 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:24.760499 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e3859b9-18bb-4477-857d-7e319c45dd26 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:24.760958 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e3859b9-18bb-4477-857d-7e319c45dd26 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:24.761722 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e3859b9-18bb-4477-857d-7e319c45dd26 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:24.762151 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e3859b9-18bb-4477-857d-7e319c45dd26 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:24.900149 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0e3859b9-18bb-4477-857d-7e319c45dd26 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:24.904599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:24.909246 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0e3859b9-18bb-4477-857d-7e319c45dd26 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.161129 Jun 27 21:17:24.918529 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 102/213] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:24 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:25.886731 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c15cfa79-730f-465e-947a-f947723c82d7 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Action: 'create', calling method: .version_select at 0x7f834f5cadc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-185162382"}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:25.926644 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bf5173b0-20c0-4000-848e-35d98452fba1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:25.927316 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bf5173b0-20c0-4000-848e-35d98452fba1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:25.934594 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf5173b0-20c0-4000-848e-35d98452fba1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:25.935040 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf5173b0-20c0-4000-848e-35d98452fba1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:25.935814 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf5173b0-20c0-4000-848e-35d98452fba1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:25.936244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf5173b0-20c0-4000-848e-35d98452fba1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:26.075923 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bf5173b0-20c0-4000-848e-35d98452fba1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:26.084343 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bf5173b0-20c0-4000-848e-35d98452fba1 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.161571 Jun 27 21:17:26.085208 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 103/214] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:25 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:26.191484 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c15cfa79-730f-465e-947a-f947723c82d7 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.423407 Jun 27 21:17:26.192071 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 112/215] 10.222.0.13 () {60 vars in 1154 bytes} [Mon Jun 27 21:17:25 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 425 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 27 21:17:26.203521 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-be8b0d3c-418f-4a30-80c4-29916b499a5c tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Calling method '.version_select at 0x7f83544b75e0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:26.254217 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-be8b0d3c-418f-4a30-80c4-29916b499a5c tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ef451df4-4814-462f-90a7-be8064555e37" status: 200 len: 344 microversion: 2.1 time: 0.054598 Jun 27 21:17:26.254804 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 104/216] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 27 21:17:26 2022] GET /compute/v2.1/os-volumes/ef451df4-4814-462f-90a7-be8064555e37 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:27.103211 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ddda7853-1784-4b5a-b36c-8749de0f7ce0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:27.103823 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ddda7853-1784-4b5a-b36c-8749de0f7ce0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:27.110996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ddda7853-1784-4b5a-b36c-8749de0f7ce0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:27.111445 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ddda7853-1784-4b5a-b36c-8749de0f7ce0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:27.112208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ddda7853-1784-4b5a-b36c-8749de0f7ce0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:27.112644 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ddda7853-1784-4b5a-b36c-8749de0f7ce0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:27.246213 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ddda7853-1784-4b5a-b36c-8749de0f7ce0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:27.254021 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ddda7853-1784-4b5a-b36c-8749de0f7ce0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.155399 Jun 27 21:17:27.254587 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 113/217] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:27 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:27.267240 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-faea4444-40ff-4f1f-b95d-ae1386088937 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Calling method '.version_select at 0x7f83544b7790>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:27.315813 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-faea4444-40ff-4f1f-b95d-ae1386088937 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ef451df4-4814-462f-90a7-be8064555e37" status: 200 len: 344 microversion: 2.1 time: 0.052563 Jun 27 21:17:27.316410 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 105/218] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 27 21:17:27 2022] GET /compute/v2.1/os-volumes/ef451df4-4814-462f-90a7-be8064555e37 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:28.270776 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ba7a8ca4-164a-40cf-ae53-bd9b08575e6a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:28.271349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ba7a8ca4-164a-40cf-ae53-bd9b08575e6a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:28.278671 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ba7a8ca4-164a-40cf-ae53-bd9b08575e6a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:28.279114 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ba7a8ca4-164a-40cf-ae53-bd9b08575e6a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:28.280219 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ba7a8ca4-164a-40cf-ae53-bd9b08575e6a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:28.280740 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ba7a8ca4-164a-40cf-ae53-bd9b08575e6a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:28.328533 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ebdefbe7-a467-47d4-b86b-7f8bee69ed8e tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Calling method '.version_select at 0x7f8354529310>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:28.378083 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ebdefbe7-a467-47d4-b86b-7f8bee69ed8e tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ef451df4-4814-462f-90a7-be8064555e37" status: 200 len: 345 microversion: 2.1 time: 0.053375 Jun 27 21:17:28.379031 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 106/219] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 27 21:17:28 2022] GET /compute/v2.1/os-volumes/ef451df4-4814-462f-90a7-be8064555e37 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:28.390143 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c4bf0f42-d885-4a8a-9e1b-0946fc22ef69 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Action: 'create', calling method: .version_select at 0x7f8354529940>, body: {"snapshot": {"volume_id": "ef451df4-4814-462f-90a7-be8064555e37", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-943625199"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:28.421738 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ba7a8ca4-164a-40cf-ae53-bd9b08575e6a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:28.429993 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ba7a8ca4-164a-40cf-ae53-bd9b08575e6a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.163052 Jun 27 21:17:28.430532 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 114/220] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:28 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:28.550488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c4bf0f42-d885-4a8a-9e1b-0946fc22ef69 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.164097 Jun 27 21:17:28.552598 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 107/221] 10.222.0.13 () {60 vars in 1161 bytes} [Mon Jun 27 21:17:28 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:28.563851 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-bb74b6c1-4c66-4840-ac35-88f8ede4f70d tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Calling method '.version_select at 0x7f834f5caf70>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:28.614697 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-bb74b6c1-4c66-4840-ac35-88f8ede4f70d tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/9b35b51d-234d-4265-9f7e-85b7fd98076e" status: 200 len: 286 microversion: 2.1 time: 0.056028 Jun 27 21:17:28.615701 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 115/222] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jun 27 21:17:28 2022] GET /compute/v2.1/os-snapshots/9b35b51d-234d-4265-9f7e-85b7fd98076e => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:28.626530 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-19702747-320a-4e9b-88d0-4070600b3198 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Calling method '.version_select at 0x7f8354529a60>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:28.715346 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-19702747-320a-4e9b-88d0-4070600b3198 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.094033 Jun 27 21:17:28.715927 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 108/223] 10.222.0.13 () {58 vars in 1139 bytes} [Mon Jun 27 21:17:28 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:28.729261 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3bab83a8-3b20-430e-ab92-bb289ad90d21 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Calling method '.version_select at 0x7f834f68e280>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:28.810290 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3bab83a8-3b20-430e-ab92-bb289ad90d21 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/9b35b51d-234d-4265-9f7e-85b7fd98076e" status: 200 len: 286 microversion: 2.1 time: 0.087177 Jun 27 21:17:28.811045 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 116/224] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jun 27 21:17:28 2022] GET /compute/v2.1/os-snapshots/9b35b51d-234d-4265-9f7e-85b7fd98076e => generated 286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:29.447140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c22fbcbe-7eb2-4112-baeb-2fecde1375f7 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:29.447818 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c22fbcbe-7eb2-4112-baeb-2fecde1375f7 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:29.454757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c22fbcbe-7eb2-4112-baeb-2fecde1375f7 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:29.455197 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c22fbcbe-7eb2-4112-baeb-2fecde1375f7 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:29.455956 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c22fbcbe-7eb2-4112-baeb-2fecde1375f7 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:29.456382 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c22fbcbe-7eb2-4112-baeb-2fecde1375f7 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:29.595015 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c22fbcbe-7eb2-4112-baeb-2fecde1375f7 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:29.603215 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c22fbcbe-7eb2-4112-baeb-2fecde1375f7 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.160192 Jun 27 21:17:29.603824 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 109/225] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:29 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:29.823531 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-82f524ad-ef7b-4357-8e74-55ddcc85f083 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Calling method '.version_select at 0x7f834f773ee0>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:29.854602 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-82f524ad-ef7b-4357-8e74-55ddcc85f083 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/9b35b51d-234d-4265-9f7e-85b7fd98076e" status: 200 len: 286 microversion: 2.1 time: 0.035631 Jun 27 21:17:29.855941 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 117/226] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jun 27 21:17:29 2022] GET /compute/v2.1/os-snapshots/9b35b51d-234d-4265-9f7e-85b7fd98076e => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:30.622044 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3ce29a2c-25d2-4463-89f4-ecf0dcef547a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:30.622583 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3ce29a2c-25d2-4463-89f4-ecf0dcef547a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:30.631384 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3ce29a2c-25d2-4463-89f4-ecf0dcef547a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:30.631815 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3ce29a2c-25d2-4463-89f4-ecf0dcef547a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:30.632563 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3ce29a2c-25d2-4463-89f4-ecf0dcef547a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:30.633131 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3ce29a2c-25d2-4463-89f4-ecf0dcef547a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:30.777666 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3ce29a2c-25d2-4463-89f4-ecf0dcef547a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:30.785351 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3ce29a2c-25d2-4463-89f4-ecf0dcef547a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.168588 Jun 27 21:17:30.785912 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 110/227] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:30 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:30.867226 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c9c32a54-8287-41ab-b303-ae7f95108964 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Calling method '.version_select at 0x7f834f68e280>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:30.898406 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c9c32a54-8287-41ab-b303-ae7f95108964 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/9b35b51d-234d-4265-9f7e-85b7fd98076e" status: 200 len: 286 microversion: 2.1 time: 0.035590 Jun 27 21:17:30.899147 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 118/228] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jun 27 21:17:30 2022] GET /compute/v2.1/os-snapshots/9b35b51d-234d-4265-9f7e-85b7fd98076e => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:31.803561 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d03a952f-4afb-416e-9193-cd46a6c5a363 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:31.804141 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d03a952f-4afb-416e-9193-cd46a6c5a363 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:31.811795 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d03a952f-4afb-416e-9193-cd46a6c5a363 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:31.812355 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d03a952f-4afb-416e-9193-cd46a6c5a363 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:31.813265 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d03a952f-4afb-416e-9193-cd46a6c5a363 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:31.813776 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d03a952f-4afb-416e-9193-cd46a6c5a363 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:31.912718 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-04e01fa6-0e51-42d7-9672-2a4a3f84cd10 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Calling method '.version_select at 0x7f834f585940>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:31.944716 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-04e01fa6-0e51-42d7-9672-2a4a3f84cd10 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/9b35b51d-234d-4265-9f7e-85b7fd98076e" status: 200 len: 286 microversion: 2.1 time: 0.036492 Jun 27 21:17:31.945331 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 119/229] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jun 27 21:17:31 2022] GET /compute/v2.1/os-snapshots/9b35b51d-234d-4265-9f7e-85b7fd98076e => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:31.952316 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d03a952f-4afb-416e-9193-cd46a6c5a363 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:31.960428 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d03a952f-4afb-416e-9193-cd46a6c5a363 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1521 microversion: 2.1 time: 0.160754 Jun 27 21:17:31.961017 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 111/230] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:31 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:32.959459 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1528bc57-209f-4216-8c5c-403513a46ca3 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Calling method '.version_select at 0x7f834f4f5d30>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:32.979328 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b47a351a-b666-4a30-a785-f5165084de2a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:32.979978 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b47a351a-b666-4a30-a785-f5165084de2a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:32.986302 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b47a351a-b666-4a30-a785-f5165084de2a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:32.986752 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b47a351a-b666-4a30-a785-f5165084de2a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:32.987531 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b47a351a-b666-4a30-a785-f5165084de2a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:32.987964 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b47a351a-b666-4a30-a785-f5165084de2a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:32.990719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1528bc57-209f-4216-8c5c-403513a46ca3 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/9b35b51d-234d-4265-9f7e-85b7fd98076e" status: 200 len: 287 microversion: 2.1 time: 0.038013 Jun 27 21:17:32.991506 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 120/231] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jun 27 21:17:32 2022] GET /compute/v2.1/os-snapshots/9b35b51d-234d-4265-9f7e-85b7fd98076e => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:33.002560 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-60d3e975-f770-405e-9eab-bb277fcbd241 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Calling method '.version_select at 0x7f834f78d040>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:33.072206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-60d3e975-f770-405e-9eab-bb277fcbd241 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/9b35b51d-234d-4265-9f7e-85b7fd98076e" status: 202 len: 0 microversion: 2.1 time: 0.072920 Jun 27 21:17:33.072780 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 121/232] 10.222.0.13 () {58 vars in 1253 bytes} [Mon Jun 27 21:17:32 2022] DELETE /compute/v2.1/os-snapshots/9b35b51d-234d-4265-9f7e-85b7fd98076e => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:17:33.081452 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-aaf70af0-b18d-4e1f-963e-07247f04ea60 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Calling method '.version_select at 0x7f834f4f10d0>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:33.118498 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-aaf70af0-b18d-4e1f-963e-07247f04ea60 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/9b35b51d-234d-4265-9f7e-85b7fd98076e" status: 200 len: 286 microversion: 2.1 time: 0.041260 Jun 27 21:17:33.119088 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 122/233] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jun 27 21:17:33 2022] GET /compute/v2.1/os-snapshots/9b35b51d-234d-4265-9f7e-85b7fd98076e => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:17:33.131695 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b47a351a-b666-4a30-a785-f5165084de2a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:33.139691 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b47a351a-b666-4a30-a785-f5165084de2a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1501 microversion: 2.1 time: 0.164834 Jun 27 21:17:33.140294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 112/234] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:32 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:17:33.156392 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-40a7dbba-12ae-4230-a564-027c3381ee3d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:33.157143 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-40a7dbba-12ae-4230-a564-027c3381ee3d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:33.164173 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-40a7dbba-12ae-4230-a564-027c3381ee3d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:33.165177 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-40a7dbba-12ae-4230-a564-027c3381ee3d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:33.166127 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-40a7dbba-12ae-4230-a564-027c3381ee3d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:33.166609 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-40a7dbba-12ae-4230-a564-027c3381ee3d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:33.311055 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-40a7dbba-12ae-4230-a564-027c3381ee3d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:33.318734 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-40a7dbba-12ae-4230-a564-027c3381ee3d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1515 microversion: 2.1 time: 0.166101 Jun 27 21:17:33.319342 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 123/235] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:33 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:34.130568 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-47d14a4b-846c-433e-82fb-0bbf537c1797 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Calling method '.version_select at 0x7f83544b7040>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:34.155799 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-47d14a4b-846c-433e-82fb-0bbf537c1797 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] HTTP exception thrown: Snapshot 9b35b51d-234d-4265-9f7e-85b7fd98076e could not be found. Jun 27 21:17:34.159335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-47d14a4b-846c-433e-82fb-0bbf537c1797 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Request method failure captured: Jun 27 21:17:34.159335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/os-snapshots/9b35b51d-234d-4265-9f7e-85b7fd98076e HTTP/1.1 Jun 27 21:17:34.159335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:17:34.159335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:17:34.159335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:17:34.159335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:17:34.159335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:17:34.159335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:17:34.159335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:17:34.159335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:17:34.159335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh5lDgNoUkFMdA2OerE07Z_HwqJGsrtLnQ9rgxlb7aK9RI0scKrJX0kgbAGOlKIKBr91q65oc8usIt7lKzZ9PFasFh0YwNwuf1U1BI441ga9mZlfyQE16HVMYPkKT9xtsR4a63Ov04xOXM-x0A6XLN4JfOeExphf-RXoC_aU5hPp-B0 Jun 27 21:17:34.159335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:17:34.159335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:17:34.159335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:17:34.159335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:17:34.159335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:17:34.159335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:17:34.159335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 6a18caba069f421e9fa5456e73b527f8 Jun 27 21:17:34.159335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1719595138 Jun 27 21:17:34.159335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:17:34.159335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:17:34.160613 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6a18caba069f421e9fa5456e73b527f8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6a18caba069f421e9fa5456e73b527f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6a18caba069f421e9fa5456e73b527f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6a18caba069f421e9fa5456e73b527f8"}]}] Jun 27 21:17:34.160613 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1719595138 Jun 27 21:17:34.160613 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 6a18caba069f421e9fa5456e73b527f8 Jun 27 21:17:34.160613 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1719595138 Jun 27 21:17:34.160613 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesSnapshotsTestJSON-1719595138-project Jun 27 21:17:34.160613 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:17:34.160613 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:17:34.160613 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: 75518e5d574541cb847d23385e8adc74 Jun 27 21:17:34.160613 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1719595138-project Jun 27 21:17:34.160613 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: Jun 27 21:17:34.160613 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Snapshot 9b35b51d-234d-4265-9f7e-85b7fd98076e could not be found. Jun 27 21:17:34.160613 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '9b35b51d-234d-4265-9f7e-85b7fd98076e'} Jun 27 21:17:34.160613 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:17:34.161409 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:34.161409 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 27 21:17:34.161409 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 27 21:17:34.161409 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 27 21:17:34.161409 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 27 21:17:34.161409 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 27 21:17:34.161409 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 27 21:17:34.161409 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 21:17:34.161409 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 21:17:34.161409 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 21:17:34.161409 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 21:17:34.161409 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:17:34.161409 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:17:34.161409 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:17:34.161409 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:17:34.161409 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9b35b51d-234d-4265-9f7e-85b7fd98076e could not be found. (HTTP 404) (Request-ID: req-1ff2ad11-3221-4980-b886-a57db03d7c53) Jun 27 21:17:34.161409 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:34.161409 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:34.162423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:34.162423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:34.162423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 27 21:17:34.162423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 27 21:17:34.162423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 21:17:34.162423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 21:17:34.162423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 27 21:17:34.162423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 27 21:17:34.162423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 21:17:34.162423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 21:17:34.162423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 27 21:17:34.162423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 27 21:17:34.162423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 27 21:17:34.162423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 27 21:17:34.162423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 27 21:17:34.162423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 27 21:17:34.162423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 21:17:34.162423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 21:17:34.162423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 21:17:34.163488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 21:17:34.163488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:17:34.163488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:17:34.163488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:17:34.163488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:17:34.163488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9b35b51d-234d-4265-9f7e-85b7fd98076e could not be found. Jun 27 21:17:34.163488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:34.163488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:34.163488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:34.163488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:34.163488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:34.163488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:34.163488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:17:34.163488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:17:34.163488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 21:17:34.163488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 21:17:34.163488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:17:34.163488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:17:34.163488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 27 21:17:34.163488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:17:34.164600 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9b35b51d-234d-4265-9f7e-85b7fd98076e could not be found. Jun 27 21:17:34.164600 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:34.164600 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:34.164600 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:34.164600 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:34.164600 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:34.164600 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:34.164600 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:17:34.164600 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:17:34.164600 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9b35b51d-234d-4265-9f7e-85b7fd98076e could not be found. Jun 27 21:17:34.164600 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:34.164600 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-47d14a4b-846c-433e-82fb-0bbf537c1797 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Returning 404 to user: Snapshot 9b35b51d-234d-4265-9f7e-85b7fd98076e could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:17:34.164600 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-47d14a4b-846c-433e-82fb-0bbf537c1797 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/9b35b51d-234d-4265-9f7e-85b7fd98076e" status: 404 len: 111 microversion: 2.1 time: 0.034119 Jun 27 21:17:34.166837 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 113/236] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jun 27 21:17:34 2022] GET /compute/v2.1/os-snapshots/9b35b51d-234d-4265-9f7e-85b7fd98076e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:17:34.170794 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-316c5fdd-f447-43e3-8bec-42e50a38bae1 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Calling method '.version_select at 0x7f83558385e0>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:34.244515 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-316c5fdd-f447-43e3-8bec-42e50a38bae1 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/ef451df4-4814-462f-90a7-be8064555e37" status: 202 len: 0 microversion: 2.1 time: 0.078233 Jun 27 21:17:34.245381 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 124/237] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 27 21:17:34 2022] DELETE /compute/v2.1/os-volumes/ef451df4-4814-462f-90a7-be8064555e37 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:17:34.253962 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e297bf7d-d013-4666-b47d-c52924896098 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Calling method '.version_select at 0x7f83546223a0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:34.310656 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e297bf7d-d013-4666-b47d-c52924896098 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ef451df4-4814-462f-90a7-be8064555e37" status: 200 len: 344 microversion: 2.1 time: 0.060812 Jun 27 21:17:34.311437 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 114/238] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 27 21:17:34 2022] GET /compute/v2.1/os-volumes/ef451df4-4814-462f-90a7-be8064555e37 => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:34.752873 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-38e16665-060c-4c6f-a491-20163fc0e90b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:34.754456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-38e16665-060c-4c6f-a491-20163fc0e90b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:34.762361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-38e16665-060c-4c6f-a491-20163fc0e90b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:34.763123 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-38e16665-060c-4c6f-a491-20163fc0e90b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:34.764357 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-38e16665-060c-4c6f-a491-20163fc0e90b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:34.765105 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-38e16665-060c-4c6f-a491-20163fc0e90b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:34.795710 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-38e16665-060c-4c6f-a491-20163fc0e90b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lazy-loading 'flavor' on Instance uuid 53419a08-6ab0-4f25-82f9-81496ca7440e {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:17:34.924371 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-38e16665-060c-4c6f-a491-20163fc0e90b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "POST /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e/action" status: 200 len: 32 microversion: 2.1 time: 0.179827 Jun 27 21:17:34.925000 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 125/239] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 27 21:17:34 2022] POST /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e/action => generated 32 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 21:17:34.934943 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e6155846-6fd2-47fe-9f27-ee3ce47e842e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:34.935867 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e6155846-6fd2-47fe-9f27-ee3ce47e842e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:34.942202 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6155846-6fd2-47fe-9f27-ee3ce47e842e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:34.942643 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6155846-6fd2-47fe-9f27-ee3ce47e842e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:34.943547 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6155846-6fd2-47fe-9f27-ee3ce47e842e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:34.943840 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6155846-6fd2-47fe-9f27-ee3ce47e842e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:35.095995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e6155846-6fd2-47fe-9f27-ee3ce47e842e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:35.104591 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e6155846-6fd2-47fe-9f27-ee3ce47e842e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1521 microversion: 2.1 time: 0.174145 Jun 27 21:17:35.105224 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 115/240] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:34 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:35.325422 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0f23c7c8-70d5-47b4-ba9c-b5541e2c2ada tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Calling method '.version_select at 0x7f834f5cad30>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:35.362322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-0f23c7c8-70d5-47b4-ba9c-b5541e2c2ada tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] HTTP exception thrown: Volume ef451df4-4814-462f-90a7-be8064555e37 could not be found. Jun 27 21:17:35.366170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0f23c7c8-70d5-47b4-ba9c-b5541e2c2ada tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Request method failure captured: Jun 27 21:17:35.366170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/os-volumes/ef451df4-4814-462f-90a7-be8064555e37 HTTP/1.1 Jun 27 21:17:35.366170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:17:35.366170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:17:35.366170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:17:35.366170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:17:35.366170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:17:35.366170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:17:35.366170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:17:35.366170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:17:35.366170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh5lDgNoUkFMdA2OerE07Z_HwqJGsrtLnQ9rgxlb7aK9RI0scKrJX0kgbAGOlKIKBr91q65oc8usIt7lKzZ9PFasFh0YwNwuf1U1BI441ga9mZlfyQE16HVMYPkKT9xtsR4a63Ov04xOXM-x0A6XLN4JfOeExphf-RXoC_aU5hPp-B0 Jun 27 21:17:35.366170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:17:35.366170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:17:35.366170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:17:35.366170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:17:35.366170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:17:35.366170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:17:35.366170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: 6a18caba069f421e9fa5456e73b527f8 Jun 27 21:17:35.366170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1719595138 Jun 27 21:17:35.366170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:17:35.366170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:17:35.367613 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6a18caba069f421e9fa5456e73b527f8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6a18caba069f421e9fa5456e73b527f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6a18caba069f421e9fa5456e73b527f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6a18caba069f421e9fa5456e73b527f8"}]}] Jun 27 21:17:35.367613 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1719595138 Jun 27 21:17:35.367613 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 6a18caba069f421e9fa5456e73b527f8 Jun 27 21:17:35.367613 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1719595138 Jun 27 21:17:35.367613 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-VolumesSnapshotsTestJSON-1719595138-project Jun 27 21:17:35.367613 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:17:35.367613 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:17:35.367613 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: 75518e5d574541cb847d23385e8adc74 Jun 27 21:17:35.367613 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1719595138-project Jun 27 21:17:35.367613 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: Jun 27 21:17:35.367613 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Volume ef451df4-4814-462f-90a7-be8064555e37 could not be found. Jun 27 21:17:35.367613 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'id': 'ef451df4-4814-462f-90a7-be8064555e37'} Jun 27 21:17:35.367613 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:17:35.368644 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:35.368644 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:17:35.368644 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:17:35.368644 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 21:17:35.368644 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 21:17:35.368644 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 21:17:35.368644 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 21:17:35.368644 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 21:17:35.368644 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 21:17:35.368644 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 21:17:35.368644 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 21:17:35.368644 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:17:35.368644 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:17:35.368644 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:17:35.368644 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:17:35.368644 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ef451df4-4814-462f-90a7-be8064555e37 could not be found. (HTTP 404) (Request-ID: req-7eb7c15d-1769-44ce-9ba1-4f534ac9b630) Jun 27 21:17:35.368644 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:35.368644 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:35.368644 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:35.370169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:35.370169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 21:17:35.370169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 21:17:35.370169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 21:17:35.370169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 21:17:35.370169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 21:17:35.370169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 21:17:35.370169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 21:17:35.370169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 21:17:35.370169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:17:35.370169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:17:35.370169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 21:17:35.370169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 21:17:35.370169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 21:17:35.370169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 21:17:35.370169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 21:17:35.370169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 21:17:35.370169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 21:17:35.370169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 21:17:35.371481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:17:35.371481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:17:35.371481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:17:35.371481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:17:35.371481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ef451df4-4814-462f-90a7-be8064555e37 could not be found. Jun 27 21:17:35.371481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:35.371481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:35.371481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:35.371481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:35.371481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:35.371481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:35.371481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:17:35.371481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:17:35.371481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 21:17:35.371481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 21:17:35.371481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:17:35.371481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:17:35.371481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 21:17:35.371481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:17:35.372736 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ef451df4-4814-462f-90a7-be8064555e37 could not be found. Jun 27 21:17:35.372736 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:35.372736 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:35.372736 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:35.372736 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:35.372736 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:35.372736 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:35.372736 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:17:35.372736 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:17:35.372736 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ef451df4-4814-462f-90a7-be8064555e37 could not be found. Jun 27 21:17:35.372736 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:35.372736 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0f23c7c8-70d5-47b4-ba9c-b5541e2c2ada tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Returning 404 to user: Volume ef451df4-4814-462f-90a7-be8064555e37 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:17:35.372736 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0f23c7c8-70d5-47b4-ba9c-b5541e2c2ada tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ef451df4-4814-462f-90a7-be8064555e37" status: 404 len: 109 microversion: 2.1 time: 0.047883 Jun 27 21:17:35.372736 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 126/241] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 27 21:17:35 2022] GET /compute/v2.1/os-volumes/ef451df4-4814-462f-90a7-be8064555e37 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:17:35.383383 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b0383eb9-984f-4738-b331-851cec7343ea tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Calling method '.version_select at 0x7f83545290d0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:35.423344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-b0383eb9-984f-4738-b331-851cec7343ea tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] HTTP exception thrown: Volume ef451df4-4814-462f-90a7-be8064555e37 could not be found. Jun 27 21:17:35.425892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b0383eb9-984f-4738-b331-851cec7343ea tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Request method failure captured: Jun 27 21:17:35.425892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/os-volumes/ef451df4-4814-462f-90a7-be8064555e37 HTTP/1.1 Jun 27 21:17:35.425892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:17:35.425892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:17:35.425892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:17:35.425892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:17:35.425892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:17:35.425892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:17:35.425892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:17:35.425892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:17:35.425892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh5lDgNoUkFMdA2OerE07Z_HwqJGsrtLnQ9rgxlb7aK9RI0scKrJX0kgbAGOlKIKBr91q65oc8usIt7lKzZ9PFasFh0YwNwuf1U1BI441ga9mZlfyQE16HVMYPkKT9xtsR4a63Ov04xOXM-x0A6XLN4JfOeExphf-RXoC_aU5hPp-B0 Jun 27 21:17:35.425892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:17:35.425892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:17:35.425892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:17:35.425892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:17:35.425892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:17:35.425892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:17:35.425892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 6a18caba069f421e9fa5456e73b527f8 Jun 27 21:17:35.425892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1719595138 Jun 27 21:17:35.425892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:17:35.425892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:17:35.427321 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6a18caba069f421e9fa5456e73b527f8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6a18caba069f421e9fa5456e73b527f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6a18caba069f421e9fa5456e73b527f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6a18caba069f421e9fa5456e73b527f8"}]}] Jun 27 21:17:35.427321 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1719595138 Jun 27 21:17:35.427321 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 6a18caba069f421e9fa5456e73b527f8 Jun 27 21:17:35.427321 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1719595138 Jun 27 21:17:35.427321 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesSnapshotsTestJSON-1719595138-project Jun 27 21:17:35.427321 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:17:35.427321 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:17:35.427321 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: 75518e5d574541cb847d23385e8adc74 Jun 27 21:17:35.427321 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1719595138-project Jun 27 21:17:35.427321 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: Jun 27 21:17:35.427321 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Volume ef451df4-4814-462f-90a7-be8064555e37 could not be found. Jun 27 21:17:35.427321 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': 'ef451df4-4814-462f-90a7-be8064555e37'} Jun 27 21:17:35.427321 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:17:35.428206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:35.428206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:17:35.428206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:17:35.428206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 21:17:35.428206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 21:17:35.428206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 21:17:35.428206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 21:17:35.428206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 21:17:35.428206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 21:17:35.428206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 21:17:35.428206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 21:17:35.428206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:17:35.428206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:17:35.428206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:17:35.428206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:17:35.428206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ef451df4-4814-462f-90a7-be8064555e37 could not be found. (HTTP 404) (Request-ID: req-62b65e01-ff79-457e-bf44-db61609fd9a7) Jun 27 21:17:35.428206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:35.428206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:35.428206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:35.429489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:35.429489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 27 21:17:35.429489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 27 21:17:35.429489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 21:17:35.429489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 21:17:35.429489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 21:17:35.429489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 21:17:35.429489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 21:17:35.429489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 21:17:35.429489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:17:35.429489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:17:35.429489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 21:17:35.429489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 21:17:35.429489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 21:17:35.429489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 21:17:35.429489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 21:17:35.429489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 21:17:35.429489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 21:17:35.429489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 21:17:35.430757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:17:35.430757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:17:35.430757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:17:35.430757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:17:35.430757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ef451df4-4814-462f-90a7-be8064555e37 could not be found. Jun 27 21:17:35.430757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:35.430757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:35.430757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:35.430757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:35.430757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:35.430757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:35.430757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:17:35.430757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:17:35.430757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 21:17:35.430757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 21:17:35.430757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:17:35.430757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:17:35.430757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 27 21:17:35.430757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:17:35.432068 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ef451df4-4814-462f-90a7-be8064555e37 could not be found. Jun 27 21:17:35.432068 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:35.432068 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:35.432068 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:35.432068 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:35.432068 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:35.432068 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:35.432068 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:17:35.432068 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:17:35.432068 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ef451df4-4814-462f-90a7-be8064555e37 could not be found. Jun 27 21:17:35.432068 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:17:35.432068 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b0383eb9-984f-4738-b331-851cec7343ea tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Returning 404 to user: Volume ef451df4-4814-462f-90a7-be8064555e37 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:17:35.433617 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b0383eb9-984f-4738-b331-851cec7343ea tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/ef451df4-4814-462f-90a7-be8064555e37" status: 404 len: 109 microversion: 2.1 time: 0.054347 Jun 27 21:17:35.434402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 116/242] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 27 21:17:35 2022] DELETE /compute/v2.1/os-volumes/ef451df4-4814-462f-90a7-be8064555e37 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:17:35.442874 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ab0631b9-a46b-4c49-af56-f608c7075622 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Calling method '.version_select at 0x7f834f585430>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:35.474098 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-ab0631b9-a46b-4c49-af56-f608c7075622 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] HTTP exception thrown: Volume ef451df4-4814-462f-90a7-be8064555e37 could not be found. Jun 27 21:17:35.477308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ab0631b9-a46b-4c49-af56-f608c7075622 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Request method failure captured: Jun 27 21:17:35.477308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/os-volumes/ef451df4-4814-462f-90a7-be8064555e37 HTTP/1.1 Jun 27 21:17:35.477308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:17:35.477308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:17:35.477308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:17:35.477308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:17:35.477308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:17:35.477308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:17:35.477308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:17:35.477308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:17:35.477308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh5lDgNoUkFMdA2OerE07Z_HwqJGsrtLnQ9rgxlb7aK9RI0scKrJX0kgbAGOlKIKBr91q65oc8usIt7lKzZ9PFasFh0YwNwuf1U1BI441ga9mZlfyQE16HVMYPkKT9xtsR4a63Ov04xOXM-x0A6XLN4JfOeExphf-RXoC_aU5hPp-B0 Jun 27 21:17:35.477308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:17:35.477308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:17:35.477308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:17:35.477308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:17:35.477308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:17:35.477308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:17:35.477308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: 6a18caba069f421e9fa5456e73b527f8 Jun 27 21:17:35.477308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1719595138 Jun 27 21:17:35.477308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:17:35.477308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:17:35.478799 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6a18caba069f421e9fa5456e73b527f8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6a18caba069f421e9fa5456e73b527f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6a18caba069f421e9fa5456e73b527f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6a18caba069f421e9fa5456e73b527f8"}]}] Jun 27 21:17:35.478799 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1719595138 Jun 27 21:17:35.478799 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 6a18caba069f421e9fa5456e73b527f8 Jun 27 21:17:35.478799 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1719595138 Jun 27 21:17:35.478799 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-VolumesSnapshotsTestJSON-1719595138-project Jun 27 21:17:35.478799 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:17:35.478799 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:17:35.478799 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: 75518e5d574541cb847d23385e8adc74 Jun 27 21:17:35.478799 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1719595138-project Jun 27 21:17:35.478799 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: Jun 27 21:17:35.478799 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Volume ef451df4-4814-462f-90a7-be8064555e37 could not be found. Jun 27 21:17:35.478799 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'id': 'ef451df4-4814-462f-90a7-be8064555e37'} Jun 27 21:17:35.478799 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:17:35.479778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:35.479778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:17:35.479778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:17:35.479778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 21:17:35.479778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 21:17:35.479778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 21:17:35.479778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 21:17:35.479778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 21:17:35.479778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 21:17:35.479778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 21:17:35.479778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 21:17:35.479778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:17:35.479778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:17:35.479778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:17:35.479778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:17:35.479778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ef451df4-4814-462f-90a7-be8064555e37 could not be found. (HTTP 404) (Request-ID: req-f73c5de5-cf22-4c11-a2a7-4598748b9a21) Jun 27 21:17:35.479778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:35.479778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:35.479778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:35.481190 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:35.481190 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 21:17:35.481190 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 21:17:35.481190 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 21:17:35.481190 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 21:17:35.481190 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 21:17:35.481190 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 21:17:35.481190 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 21:17:35.481190 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 21:17:35.481190 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:17:35.481190 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:17:35.481190 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 21:17:35.481190 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 21:17:35.481190 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 21:17:35.481190 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 21:17:35.481190 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 21:17:35.481190 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 21:17:35.481190 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 21:17:35.481190 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 21:17:35.482857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:17:35.482857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:17:35.482857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:17:35.482857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:17:35.482857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ef451df4-4814-462f-90a7-be8064555e37 could not be found. Jun 27 21:17:35.482857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:35.482857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:35.482857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:35.482857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:35.482857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:35.482857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:35.482857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:17:35.482857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:17:35.482857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 21:17:35.482857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 21:17:35.482857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:17:35.482857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:17:35.482857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 21:17:35.482857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:17:35.483990 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ef451df4-4814-462f-90a7-be8064555e37 could not be found. Jun 27 21:17:35.483990 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:35.483990 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:35.483990 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:35.483990 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:35.483990 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:35.483990 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:35.483990 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:17:35.483990 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:17:35.483990 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ef451df4-4814-462f-90a7-be8064555e37 could not be found. Jun 27 21:17:35.483990 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:35.483990 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ab0631b9-a46b-4c49-af56-f608c7075622 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] Returning 404 to user: Volume ef451df4-4814-462f-90a7-be8064555e37 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:17:35.483990 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ab0631b9-a46b-4c49-af56-f608c7075622 tempest-VolumesSnapshotsTestJSON-1719595138 tempest-VolumesSnapshotsTestJSON-1719595138-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ef451df4-4814-462f-90a7-be8064555e37" status: 404 len: 109 microversion: 2.1 time: 0.040199 Jun 27 21:17:35.483990 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 127/243] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 27 21:17:35 2022] GET /compute/v2.1/os-volumes/ef451df4-4814-462f-90a7-be8064555e37 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:17:36.121963 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e6082b58-38b0-4c97-ac33-a313453c76e0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:36.133519 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e6082b58-38b0-4c97-ac33-a313453c76e0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:36.149305 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6082b58-38b0-4c97-ac33-a313453c76e0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:36.154138 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6082b58-38b0-4c97-ac33-a313453c76e0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:36.157662 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6082b58-38b0-4c97-ac33-a313453c76e0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:36.158111 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6082b58-38b0-4c97-ac33-a313453c76e0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:36.365531 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e6082b58-38b0-4c97-ac33-a313453c76e0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:36.374075 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e6082b58-38b0-4c97-ac33-a313453c76e0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1521 microversion: 2.1 time: 0.256114 Jun 27 21:17:36.374723 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 117/244] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:36 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:37.393168 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7678be55-631d-411e-950f-7fab4beb2643 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:37.393978 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7678be55-631d-411e-950f-7fab4beb2643 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:37.407576 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7678be55-631d-411e-950f-7fab4beb2643 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:37.413787 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7678be55-631d-411e-950f-7fab4beb2643 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:37.415014 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7678be55-631d-411e-950f-7fab4beb2643 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:37.415670 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7678be55-631d-411e-950f-7fab4beb2643 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:37.678597 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7678be55-631d-411e-950f-7fab4beb2643 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:37.695136 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7678be55-631d-411e-950f-7fab4beb2643 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1521 microversion: 2.1 time: 0.307260 Jun 27 21:17:37.697008 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 128/245] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:37 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:38.714481 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-314163cd-48d1-4ccb-a0b1-5d3b12b5ceef tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:38.715693 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-314163cd-48d1-4ccb-a0b1-5d3b12b5ceef tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:38.731260 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-314163cd-48d1-4ccb-a0b1-5d3b12b5ceef tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:38.731485 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-314163cd-48d1-4ccb-a0b1-5d3b12b5ceef tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:38.733168 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-314163cd-48d1-4ccb-a0b1-5d3b12b5ceef tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:38.734143 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-314163cd-48d1-4ccb-a0b1-5d3b12b5ceef tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:38.931818 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-314163cd-48d1-4ccb-a0b1-5d3b12b5ceef tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:38.942950 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-314163cd-48d1-4ccb-a0b1-5d3b12b5ceef tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1521 microversion: 2.1 time: 0.233480 Jun 27 21:17:38.943549 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 118/246] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:38 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:39.964978 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ee2f8dad-2df1-4b3e-a747-efed75c08c26 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:39.967150 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ee2f8dad-2df1-4b3e-a747-efed75c08c26 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:39.985710 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee2f8dad-2df1-4b3e-a747-efed75c08c26 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:39.987920 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee2f8dad-2df1-4b3e-a747-efed75c08c26 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:39.990237 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee2f8dad-2df1-4b3e-a747-efed75c08c26 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:39.991237 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee2f8dad-2df1-4b3e-a747-efed75c08c26 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:40.320708 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ee2f8dad-2df1-4b3e-a747-efed75c08c26 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:40.334413 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ee2f8dad-2df1-4b3e-a747-efed75c08c26 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1521 microversion: 2.1 time: 0.375750 Jun 27 21:17:40.335978 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 129/247] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:39 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:41.362411 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-dccc5593-faae-446f-b805-a6a5339cfca6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:41.363125 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-dccc5593-faae-446f-b805-a6a5339cfca6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:41.371658 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dccc5593-faae-446f-b805-a6a5339cfca6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:41.372065 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dccc5593-faae-446f-b805-a6a5339cfca6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:41.373211 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dccc5593-faae-446f-b805-a6a5339cfca6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:41.373573 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dccc5593-faae-446f-b805-a6a5339cfca6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:41.548252 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-dccc5593-faae-446f-b805-a6a5339cfca6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:41.562647 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-dccc5593-faae-446f-b805-a6a5339cfca6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1521 microversion: 2.1 time: 0.210232 Jun 27 21:17:41.568903 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 119/248] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:41 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:42.583710 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-756c9647-702d-44e6-b346-19137da5074b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:42.584313 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-756c9647-702d-44e6-b346-19137da5074b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:42.588538 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=36 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:42.603473 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-756c9647-702d-44e6-b346-19137da5074b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:42.603922 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-756c9647-702d-44e6-b346-19137da5074b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:42.604708 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-756c9647-702d-44e6-b346-19137da5074b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:42.605172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-756c9647-702d-44e6-b346-19137da5074b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:43.031748 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-756c9647-702d-44e6-b346-19137da5074b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:43.040505 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-756c9647-702d-44e6-b346-19137da5074b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1521 microversion: 2.1 time: 0.460505 Jun 27 21:17:43.045087 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 130/249] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:42 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1521 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:44.057446 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ff27681b-b71d-48b0-af07-4f1c2c619ce9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:44.058057 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ff27681b-b71d-48b0-af07-4f1c2c619ce9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:44.073722 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ff27681b-b71d-48b0-af07-4f1c2c619ce9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:44.075724 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ff27681b-b71d-48b0-af07-4f1c2c619ce9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:44.078299 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ff27681b-b71d-48b0-af07-4f1c2c619ce9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:44.078600 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ff27681b-b71d-48b0-af07-4f1c2c619ce9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:44.359338 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ff27681b-b71d-48b0-af07-4f1c2c619ce9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:44.372747 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ff27681b-b71d-48b0-af07-4f1c2c619ce9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1521 microversion: 2.1 time: 0.318010 Jun 27 21:17:44.383514 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 120/250] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:44 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:45.393496 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-378d746f-633b-459d-8dce-f538c0347b77 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:45.394253 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-378d746f-633b-459d-8dce-f538c0347b77 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:45.410882 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-378d746f-633b-459d-8dce-f538c0347b77 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:45.411344 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-378d746f-633b-459d-8dce-f538c0347b77 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:45.414337 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-378d746f-633b-459d-8dce-f538c0347b77 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:45.417253 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-378d746f-633b-459d-8dce-f538c0347b77 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:45.625152 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-378d746f-633b-459d-8dce-f538c0347b77 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:45.639962 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-378d746f-633b-459d-8dce-f538c0347b77 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1521 microversion: 2.1 time: 0.253601 Jun 27 21:17:45.641097 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 131/251] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:45 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:46.657484 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-082762d5-b617-41ed-894a-c61250e19c4e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:46.658095 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-082762d5-b617-41ed-894a-c61250e19c4e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:46.665168 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-082762d5-b617-41ed-894a-c61250e19c4e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:46.665529 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-082762d5-b617-41ed-894a-c61250e19c4e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:46.666324 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-082762d5-b617-41ed-894a-c61250e19c4e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:46.666733 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-082762d5-b617-41ed-894a-c61250e19c4e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:46.971693 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-082762d5-b617-41ed-894a-c61250e19c4e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:46.982231 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-082762d5-b617-41ed-894a-c61250e19c4e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1521 microversion: 2.1 time: 0.328498 Jun 27 21:17:46.984591 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 121/252] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:46 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:17:47.941755 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a49d112c-10e9-4372-8a58-7a8204d0d77d tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Action: 'create', calling method: .version_select at 0x7f834f4f1280>, body: {"keypair": {"name": "tempest-TestShelveInstance-1869209914", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLatFDbsxGkEBigSLMnZLkOGivk83Z/qapHVfGRti6FfmxZYq07orT/XjieEpX6db+v8CzYpXnkx8YZYxzcr9stNaojaa5DInJKDLLwGP5MUXWrrly8AqMsQWcaM4T82jA=="}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:47.956550 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-a49d112c-10e9-4372-8a58-7a8204d0d77d tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Getting quotas for project f484976e63ce44daa10eadd2a9d6cc76. Resources: {'key_pairs'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:17:47.961115 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-a49d112c-10e9-4372-8a58-7a8204d0d77d tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Getting quotas for user 4e8428365f1148a2934dd4596deeb43a and project f484976e63ce44daa10eadd2a9d6cc76. Resources: {'key_pairs'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:17:47.986254 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a49d112c-10e9-4372-8a58-7a8204d0d77d tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.271241 Jun 27 21:17:47.986867 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 132/253] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 27 21:17:47 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:48.006303 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2b5f62ba-5875-43e7-9920-2e7cea7587b6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:48.007002 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2b5f62ba-5875-43e7-9920-2e7cea7587b6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:48.023029 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b5f62ba-5875-43e7-9920-2e7cea7587b6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:48.024233 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b5f62ba-5875-43e7-9920-2e7cea7587b6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:48.025368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b5f62ba-5875-43e7-9920-2e7cea7587b6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:48.026757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b5f62ba-5875-43e7-9920-2e7cea7587b6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:48.266915 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2b5f62ba-5875-43e7-9920-2e7cea7587b6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:48.278121 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2b5f62ba-5875-43e7-9920-2e7cea7587b6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1521 microversion: 2.1 time: 0.281517 Jun 27 21:17:48.279102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 122/254] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:47 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:49.295830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-358a7d5a-cd8a-4e92-a553-51da0527f429 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:49.297211 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-358a7d5a-cd8a-4e92-a553-51da0527f429 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:49.318567 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-358a7d5a-cd8a-4e92-a553-51da0527f429 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:49.319392 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-358a7d5a-cd8a-4e92-a553-51da0527f429 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:49.321196 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-358a7d5a-cd8a-4e92-a553-51da0527f429 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:49.324547 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-358a7d5a-cd8a-4e92-a553-51da0527f429 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:49.346955 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:49.542195 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-358a7d5a-cd8a-4e92-a553-51da0527f429 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:49.564556 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-358a7d5a-cd8a-4e92-a553-51da0527f429 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1521 microversion: 2.1 time: 0.271237 Jun 27 21:17:49.565912 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 133/255] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:49 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:50.584035 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1811c179-6400-4b9b-8cc8-405c657a0fec tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:50.585424 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1811c179-6400-4b9b-8cc8-405c657a0fec tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:50.593453 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1811c179-6400-4b9b-8cc8-405c657a0fec tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:50.594046 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1811c179-6400-4b9b-8cc8-405c657a0fec tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:50.595008 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1811c179-6400-4b9b-8cc8-405c657a0fec tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:50.595475 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1811c179-6400-4b9b-8cc8-405c657a0fec tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:50.787210 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1811c179-6400-4b9b-8cc8-405c657a0fec tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:50.796075 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1811c179-6400-4b9b-8cc8-405c657a0fec tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1521 microversion: 2.1 time: 0.216526 Jun 27 21:17:50.796700 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 123/256] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:50 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:51.818070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1b15ed01-96b1-45cb-9216-009bdc8e630c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:51.818814 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1b15ed01-96b1-45cb-9216-009bdc8e630c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:51.828763 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1b15ed01-96b1-45cb-9216-009bdc8e630c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:51.829416 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1b15ed01-96b1-45cb-9216-009bdc8e630c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:51.831033 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1b15ed01-96b1-45cb-9216-009bdc8e630c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:51.831949 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1b15ed01-96b1-45cb-9216-009bdc8e630c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:51.886511 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-89172521-00de-4372-9ef0-00073724bac5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:51.887134 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-89172521-00de-4372-9ef0-00073724bac5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:51.899998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89172521-00de-4372-9ef0-00073724bac5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:51.900449 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89172521-00de-4372-9ef0-00073724bac5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:51.901413 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89172521-00de-4372-9ef0-00073724bac5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:51.901850 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89172521-00de-4372-9ef0-00073724bac5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:51.927431 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-89172521-00de-4372-9ef0-00073724bac5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1/ips" status: 200 len: 145 microversion: 2.1 time: 0.045379 Jun 27 21:17:51.928396 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 124/257] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 27 21:17:51 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1/ips => generated 145 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:17:52.011580 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1b15ed01-96b1-45cb-9216-009bdc8e630c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:52.027168 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1b15ed01-96b1-45cb-9216-009bdc8e630c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1521 microversion: 2.1 time: 0.216100 Jun 27 21:17:52.039121 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 134/258] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:51 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:53.045986 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3b8613c5-70dd-4889-8d37-63b884e32f95 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:53.046720 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3b8613c5-70dd-4889-8d37-63b884e32f95 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:53.049924 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=32 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:53.056631 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b8613c5-70dd-4889-8d37-63b884e32f95 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:53.057117 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b8613c5-70dd-4889-8d37-63b884e32f95 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:53.057928 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b8613c5-70dd-4889-8d37-63b884e32f95 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:53.058364 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b8613c5-70dd-4889-8d37-63b884e32f95 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:53.237707 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3b8613c5-70dd-4889-8d37-63b884e32f95 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:53.247489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3b8613c5-70dd-4889-8d37-63b884e32f95 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1521 microversion: 2.1 time: 0.205390 Jun 27 21:17:53.248698 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 125/259] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:53 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:17:54.267118 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2fe4f29b-5082-457b-935e-992164409477 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:54.267885 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2fe4f29b-5082-457b-935e-992164409477 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:54.275349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2fe4f29b-5082-457b-935e-992164409477 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:54.276195 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2fe4f29b-5082-457b-935e-992164409477 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:54.276994 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2fe4f29b-5082-457b-935e-992164409477 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:54.277432 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2fe4f29b-5082-457b-935e-992164409477 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:54.428986 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2fe4f29b-5082-457b-935e-992164409477 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:54.438936 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2fe4f29b-5082-457b-935e-992164409477 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1521 microversion: 2.1 time: 0.175935 Jun 27 21:17:54.439538 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 135/260] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:54 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:54.711671 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-36267eee-ec19-4e9d-b7bd-c4813babd953 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:54.712659 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-36267eee-ec19-4e9d-b7bd-c4813babd953 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:54.719522 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-36267eee-ec19-4e9d-b7bd-c4813babd953 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:54.719961 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-36267eee-ec19-4e9d-b7bd-c4813babd953 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:54.720723 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-36267eee-ec19-4e9d-b7bd-c4813babd953 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:54.721194 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-36267eee-ec19-4e9d-b7bd-c4813babd953 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:54.748207 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-36267eee-ec19-4e9d-b7bd-c4813babd953 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3/ips" status: 200 len: 150 microversion: 2.1 time: 0.040947 Jun 27 21:17:54.748806 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 126/261] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 27 21:17:54 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:54.877534 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8f5f50fa-d122-4afe-867c-07584a22ce48 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1c6fe0c-b9c4-4e54-b483-2b2d2fe7f388"}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:54.878655 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-8f5f50fa-d122-4afe-867c-07584a22ce48 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:54.885580 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8f5f50fa-d122-4afe-867c-07584a22ce48 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:54.886027 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8f5f50fa-d122-4afe-867c-07584a22ce48 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:54.886789 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8f5f50fa-d122-4afe-867c-07584a22ce48 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:54.887215 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8f5f50fa-d122-4afe-867c-07584a22ce48 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:55.255419 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8f5f50fa-d122-4afe-867c-07584a22ce48 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "POST /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384179 Jun 27 21:17:55.256136 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 136/262] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 27 21:17:54 2022] POST /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1/os-volume_attachments => generated 194 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:55.461206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-05158d0d-1532-4d9d-bc7e-6edaff6a4174 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:55.462630 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-05158d0d-1532-4d9d-bc7e-6edaff6a4174 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:55.469532 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-05158d0d-1532-4d9d-bc7e-6edaff6a4174 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:55.469997 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-05158d0d-1532-4d9d-bc7e-6edaff6a4174 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:55.470755 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-05158d0d-1532-4d9d-bc7e-6edaff6a4174 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:55.471197 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-05158d0d-1532-4d9d-bc7e-6edaff6a4174 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:55.608914 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-05158d0d-1532-4d9d-bc7e-6edaff6a4174 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:55.619032 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-05158d0d-1532-4d9d-bc7e-6edaff6a4174 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1501 microversion: 2.1 time: 0.161730 Jun 27 21:17:55.619893 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 127/263] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:55 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:55.638391 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-29e9c595-9829-4372-af38-83132fe3629f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23f02478-d078-4ed6-98b6-21bf1bc84172"}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:55.639933 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-29e9c595-9829-4372-af38-83132fe3629f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:55.646587 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-29e9c595-9829-4372-af38-83132fe3629f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:55.647029 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-29e9c595-9829-4372-af38-83132fe3629f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:55.647795 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-29e9c595-9829-4372-af38-83132fe3629f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:55.648221 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-29e9c595-9829-4372-af38-83132fe3629f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:55.673219 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-29e9c595-9829-4372-af38-83132fe3629f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] HTTP exception thrown: Cannot 'attach_volume' instance 53419a08-6ab0-4f25-82f9-81496ca7440e while it is in vm_state rescued Jun 27 21:17:55.675051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-29e9c595-9829-4372-af38-83132fe3629f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Request method failure captured: Jun 27 21:17:55.675051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: POST /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e/os-volume_attachments HTTP/1.1 Jun 27 21:17:55.675051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:17:55.675051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:17:55.675051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:17:55.675051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 74 Jun 27 21:17:55.675051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:17:55.675051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:17:55.675051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:17:55.675051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:17:55.675051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh4MtCUDYlYQAgDha4AvmudCjuvwvHIGW1y1KgJ39KrW_dqcQEVlDzD-XMR-AlLP_0KAJKcuGUS2Ns8xi3pVbviq_M178w8YodWUnffgx7-aVG6aPoo5C66rO-fFAe_0HQHN6yZX1qOaX4CMMRqy5foO5lwLx89IL8-rGKilhGX1QM8 Jun 27 21:17:55.675051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:17:55.675051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:17:55.675051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:17:55.675051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:17:55.675051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:17:55.675051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:17:55.675051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: a2a3853bab51428eb89ff228e5f29ef4 Jun 27 21:17:55.675051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2086275792 Jun 27 21:17:55.675051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:17:55.675051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:17:55.676472 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a2a3853bab51428eb89ff228e5f29ef4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a2a3853bab51428eb89ff228e5f29ef4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a2a3853bab51428eb89ff228e5f29ef4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a2a3853bab51428eb89ff228e5f29ef4"}]}] Jun 27 21:17:55.676472 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2086275792 Jun 27 21:17:55.676472 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: a2a3853bab51428eb89ff228e5f29ef4 Jun 27 21:17:55.676472 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2086275792 Jun 27 21:17:55.676472 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-ServerRescueNegativeTestJSON-2086275792-project Jun 27 21:17:55.676472 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:17:55.676472 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:17:55.676472 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: a0408ee5961249d1bd296a6ef1a030a9 Jun 27 21:17:55.676472 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2086275792-project Jun 27 21:17:55.676472 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Jun 27 21:17:55.676472 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {"volumeAttachment": {"volumeId": "23f02478-d078-4ed6-98b6-21bf1bc84172"}} Jun 27 21:17:55.676472 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: > Jun 27 21:17:55.677388 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Cannot 'attach_volume' instance 53419a08-6ab0-4f25-82f9-81496ca7440e while it is in vm_state rescued Jun 27 21:17:55.677388 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'server_id': '53419a08-6ab0-4f25-82f9-81496ca7440e', 'body': {'volumeAttachment': {'volumeId': '23f02478-d078-4ed6-98b6-21bf1bc84172'}}} Jun 27 21:17:55.677388 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:17:55.677388 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:55.677388 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 27 21:17:55.677388 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 27 21:17:55.677388 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 21:17:55.677388 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 21:17:55.677388 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 27 21:17:55.677388 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 27 21:17:55.677388 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 53419a08-6ab0-4f25-82f9-81496ca7440e in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 27 21:17:55.677388 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:55.677388 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:55.677388 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:55.677388 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:55.677388 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:55.677388 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:55.677388 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:17:55.677388 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:17:55.678684 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:17:55.678684 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:17:55.678684 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 21:17:55.678684 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 21:17:55.678684 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 21:17:55.678684 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 21:17:55.678684 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 21:17:55.678684 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 21:17:55.678684 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 27 21:17:55.678684 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 27 21:17:55.678684 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 27 21:17:55.678684 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 27 21:17:55.678684 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 53419a08-6ab0-4f25-82f9-81496ca7440e while it is in vm_state rescued Jun 27 21:17:55.678684 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:55.678684 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:55.678684 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:55.678684 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:55.678684 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:55.678684 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:55.680210 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:17:55.680210 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:17:55.680210 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 53419a08-6ab0-4f25-82f9-81496ca7440e while it is in vm_state rescued Jun 27 21:17:55.680210 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:17:55.681404 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-29e9c595-9829-4372-af38-83132fe3629f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Returning 409 to user: Cannot 'attach_volume' instance 53419a08-6ab0-4f25-82f9-81496ca7440e while it is in vm_state rescued {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:17:55.682333 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-29e9c595-9829-4372-af38-83132fe3629f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "POST /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049470 Jun 27 21:17:55.683306 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 137/264] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 27 21:17:55 2022] POST /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 27 21:17:55.693180 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-efa4edb8-0fd5-4676-8c6d-ba417e47262f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:55.693904 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-efa4edb8-0fd5-4676-8c6d-ba417e47262f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:55.701810 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-efa4edb8-0fd5-4676-8c6d-ba417e47262f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:55.702297 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-efa4edb8-0fd5-4676-8c6d-ba417e47262f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:55.703162 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-efa4edb8-0fd5-4676-8c6d-ba417e47262f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:55.703678 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-efa4edb8-0fd5-4676-8c6d-ba417e47262f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:55.709498 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:55.796639 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-efa4edb8-0fd5-4676-8c6d-ba417e47262f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "POST /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e/action" status: 202 len: 0 microversion: 2.1 time: 0.108293 Jun 27 21:17:55.797767 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 128/265] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 27 21:17:55 2022] POST /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:17:55.805621 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5c34a95c-1866-4386-9553-243ecfb5d0e9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:55.806637 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-5c34a95c-1866-4386-9553-243ecfb5d0e9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:55.821385 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5c34a95c-1866-4386-9553-243ecfb5d0e9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:55.821948 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5c34a95c-1866-4386-9553-243ecfb5d0e9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:55.823176 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5c34a95c-1866-4386-9553-243ecfb5d0e9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:55.823650 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5c34a95c-1866-4386-9553-243ecfb5d0e9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:56.092362 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5c34a95c-1866-4386-9553-243ecfb5d0e9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:56.103931 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5c34a95c-1866-4386-9553-243ecfb5d0e9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1509 microversion: 2.1 time: 0.302415 Jun 27 21:17:56.104611 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 138/266] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:55 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1509 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:17:56.188967 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0dbe4f96-cabc-44dc-9fdb-8400c5a741e0 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d382b32-bdd0-44eb-a043-184d9e87e72d"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:56.190551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0dbe4f96-cabc-44dc-9fdb-8400c5a741e0 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:56.197780 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0dbe4f96-cabc-44dc-9fdb-8400c5a741e0 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:56.198470 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0dbe4f96-cabc-44dc-9fdb-8400c5a741e0 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:56.199530 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0dbe4f96-cabc-44dc-9fdb-8400c5a741e0 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:56.199955 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0dbe4f96-cabc-44dc-9fdb-8400c5a741e0 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:56.594763 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0dbe4f96-cabc-44dc-9fdb-8400c5a741e0 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "POST /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.409781 Jun 27 21:17:56.595790 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 129/267] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 27 21:17:56 2022] POST /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3/os-volume_attachments => generated 194 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:57.123538 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6c373fe6-d99e-4706-9630-49fdc3e3012e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:57.124524 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6c373fe6-d99e-4706-9630-49fdc3e3012e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:57.132127 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6c373fe6-d99e-4706-9630-49fdc3e3012e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:57.132572 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6c373fe6-d99e-4706-9630-49fdc3e3012e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:57.133418 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6c373fe6-d99e-4706-9630-49fdc3e3012e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:57.134059 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6c373fe6-d99e-4706-9630-49fdc3e3012e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:57.324169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-6c373fe6-d99e-4706-9630-49fdc3e3012e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:57.335255 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6c373fe6-d99e-4706-9630-49fdc3e3012e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1509 microversion: 2.1 time: 0.217438 Jun 27 21:17:57.335942 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 139/268] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:57 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:58.361977 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-456530e4-b67b-4fdb-9dd1-4d03d64cb0e3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:58.362650 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-456530e4-b67b-4fdb-9dd1-4d03d64cb0e3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:58.372324 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-456530e4-b67b-4fdb-9dd1-4d03d64cb0e3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:58.373127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-456530e4-b67b-4fdb-9dd1-4d03d64cb0e3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:58.374103 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-456530e4-b67b-4fdb-9dd1-4d03d64cb0e3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:58.374645 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-456530e4-b67b-4fdb-9dd1-4d03d64cb0e3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:58.625488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-456530e4-b67b-4fdb-9dd1-4d03d64cb0e3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:58.653221 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-456530e4-b67b-4fdb-9dd1-4d03d64cb0e3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1509 microversion: 2.1 time: 0.288783 Jun 27 21:17:58.653221 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 130/269] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:58 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1509 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:17:59.675352 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ac0efedc-fb6d-40bb-97e7-2048ed491415 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:59.678376 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ac0efedc-fb6d-40bb-97e7-2048ed491415 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:59.694369 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=4 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:59.699829 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ac0efedc-fb6d-40bb-97e7-2048ed491415 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:59.700654 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ac0efedc-fb6d-40bb-97e7-2048ed491415 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:59.701993 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ac0efedc-fb6d-40bb-97e7-2048ed491415 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:59.702704 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ac0efedc-fb6d-40bb-97e7-2048ed491415 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:59.919149 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ac0efedc-fb6d-40bb-97e7-2048ed491415 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:59.938744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ac0efedc-fb6d-40bb-97e7-2048ed491415 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1515 microversion: 2.1 time: 0.269785 Jun 27 21:17:59.940006 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 140/270] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:59 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1515 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:03.583501 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6b8e5403-c0ff-46e6-b0b4-6b54b8473a32 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Action: 'create', calling method: .version_select at 0x7f83544cbaf0>, body: {"keypair": {"name": "tempest-keypair-1013538233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLiDdsy/Ax6zGisMpAUJtqd6mcdVMzojYRDyFzwlQ7JnNbP5umMTx/W1k7RIWUsZYX9L0cGw0vBWddLb5FiytOrII+BZOfZRGA4ZdKxfFXVdDEwM95gHyOHOzER0+Mu3g=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:03.608909 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-6b8e5403-c0ff-46e6-b0b4-6b54b8473a32 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Getting quotas for project a2a3853bab51428eb89ff228e5f29ef4. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:18:03.614491 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-6b8e5403-c0ff-46e6-b0b4-6b54b8473a32 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Getting quotas for user a0408ee5961249d1bd296a6ef1a030a9 and project a2a3853bab51428eb89ff228e5f29ef4. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:18:03.646366 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6b8e5403-c0ff-46e6-b0b4-6b54b8473a32 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070125 Jun 27 21:18:03.647086 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 131/271] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 27 21:18:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:18:04.143406 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-147b6205-777a-4b21-9fe5-dda516f0f672 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:04.155974 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-147b6205-777a-4b21-9fe5-dda516f0f672 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:04.156637 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-147b6205-777a-4b21-9fe5-dda516f0f672 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:04.252511 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-147b6205-777a-4b21-9fe5-dda516f0f672 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Going to try to stop instance {{(pid=117891) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 27 21:18:04.334719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-147b6205-777a-4b21-9fe5-dda516f0f672 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "POST /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1/action" status: 202 len: 0 microversion: 2.1 time: 0.193116 Jun 27 21:18:04.340343 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 141/272] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 27 21:18:04 2022] POST /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:18:04.351043 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-22649966-1a9f-451d-a78c-88eacf6a7979 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:04.352410 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-22649966-1a9f-451d-a78c-88eacf6a7979 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:04.363482 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-22649966-1a9f-451d-a78c-88eacf6a7979 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:04.364286 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-22649966-1a9f-451d-a78c-88eacf6a7979 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:04.366043 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-22649966-1a9f-451d-a78c-88eacf6a7979 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:04.366485 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-22649966-1a9f-451d-a78c-88eacf6a7979 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:04.633694 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-22649966-1a9f-451d-a78c-88eacf6a7979 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:04.654160 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-22649966-1a9f-451d-a78c-88eacf6a7979 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1724 microversion: 2.1 time: 0.310739 Jun 27 21:18:04.656023 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 132/273] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:04 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1724 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:05.667792 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1fadf451-7867-4229-b13d-c36206c228c0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1938773304", "imageRef": "3155f228-b1ff-487e-837f-85eec68c250a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e4e94ff-9f19-4780-958f-2bffc629b050"}], "security_groups": [{"name": "tempest-securitygroup--112390341"}], "key_name": "tempest-keypair-1013538233", "user_data": "}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:05.687650 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-76dcbc0c-fa3c-419b-b930-1ff875d25503 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:05.689786 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-76dcbc0c-fa3c-419b-b930-1ff875d25503 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:05.701290 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76dcbc0c-fa3c-419b-b930-1ff875d25503 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:05.701972 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76dcbc0c-fa3c-419b-b930-1ff875d25503 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:05.703452 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76dcbc0c-fa3c-419b-b930-1ff875d25503 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:05.704599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76dcbc0c-fa3c-419b-b930-1ff875d25503 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:05.876580 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.network.neutron [None req-1fadf451-7867-4229-b13d-c36206c228c0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] validate_networks() for [('8e4e94ff-9f19-4780-958f-2bffc629b050', None, None, None, None, None)] {{(pid=117891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:18:05.974023 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-76dcbc0c-fa3c-419b-b930-1ff875d25503 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:05.985934 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-76dcbc0c-fa3c-419b-b930-1ff875d25503 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1724 microversion: 2.1 time: 0.306444 Jun 27 21:18:05.987105 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 133/274] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:05 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:06.446159 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-1fadf451-7867-4229-b13d-c36206c228c0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Flavor limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:18:06.446946 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-1fadf451-7867-4229-b13d-c36206c228c0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Image limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:18:06.447616 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-1fadf451-7867-4229-b13d-c36206c228c0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Flavor pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:18:06.448201 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-1fadf451-7867-4229-b13d-c36206c228c0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Image pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:18:06.449036 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-1fadf451-7867-4229-b13d-c36206c228c0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:18:06.459681 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1fadf451-7867-4229-b13d-c36206c228c0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:06.460394 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1fadf451-7867-4229-b13d-c36206c228c0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:06.461505 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1fadf451-7867-4229-b13d-c36206c228c0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:06.462506 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1fadf451-7867-4229-b13d-c36206c228c0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:06.493223 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-1fadf451-7867-4229-b13d-c36206c228c0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Getting quotas for project a2a3853bab51428eb89ff228e5f29ef4. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:18:06.501188 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-1fadf451-7867-4229-b13d-c36206c228c0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Getting quotas for user a0408ee5961249d1bd296a6ef1a030a9 and project a2a3853bab51428eb89ff228e5f29ef4. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:18:06.523186 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1fadf451-7867-4229-b13d-c36206c228c0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Going to run 1 instances... {{(pid=117891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:18:06.528088 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1fadf451-7867-4229-b13d-c36206c228c0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3155f228-b1ff-487e-837f-85eec68c250a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:18:06.622238 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1fadf451-7867-4229-b13d-c36206c228c0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.961438 Jun 27 21:18:06.633565 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-eda7e0c3-fc5e-4eea-ae8a-3c3998cd8388 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:06.634579 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-eda7e0c3-fc5e-4eea-ae8a-3c3998cd8388 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:06.637868 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 142/275] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 27 21:18:05 2022] POST /compute/v2.1/servers => generated 408 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:18:06.729107 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-eda7e0c3-fc5e-4eea-ae8a-3c3998cd8388 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:06.745279 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-eda7e0c3-fc5e-4eea-ae8a-3c3998cd8388 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1246 microversion: 2.1 time: 0.115070 Jun 27 21:18:06.747164 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 134/276] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:06 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1246 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:18:06.822409 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-837d411c-4302-41a3-b47f-7a65d512a084 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:06.827268 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-837d411c-4302-41a3-b47f-7a65d512a084 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:06.848340 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-837d411c-4302-41a3-b47f-7a65d512a084 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:06.848804 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-837d411c-4302-41a3-b47f-7a65d512a084 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:06.849633 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-837d411c-4302-41a3-b47f-7a65d512a084 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:06.855820 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-837d411c-4302-41a3-b47f-7a65d512a084 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:06.920780 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-837d411c-4302-41a3-b47f-7a65d512a084 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1/ips" status: 200 len: 151 microversion: 2.20 time: 0.107633 Jun 27 21:18:06.921829 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 143/277] 10.222.0.13 () {60 vars in 1288 bytes} [Mon Jun 27 21:18:06 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1/ips => generated 151 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:18:07.007298 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b6f813ed-1ae4-4a7a-abec-dec50ab1b2ff tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:07.008207 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b6f813ed-1ae4-4a7a-abec-dec50ab1b2ff tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:07.042547 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6f813ed-1ae4-4a7a-abec-dec50ab1b2ff tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:07.045977 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6f813ed-1ae4-4a7a-abec-dec50ab1b2ff tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:07.055142 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6f813ed-1ae4-4a7a-abec-dec50ab1b2ff tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:07.055895 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6f813ed-1ae4-4a7a-abec-dec50ab1b2ff tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:07.517414 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b6f813ed-1ae4-4a7a-abec-dec50ab1b2ff tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:07.528708 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b6f813ed-1ae4-4a7a-abec-dec50ab1b2ff tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1724 microversion: 2.1 time: 0.527697 Jun 27 21:18:07.529877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 135/278] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:06 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1724 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:07.766237 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a90c042f-3150-4b59-93b4-d93c49c7e1d3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:07.766970 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a90c042f-3150-4b59-93b4-d93c49c7e1d3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:07.774349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a90c042f-3150-4b59-93b4-d93c49c7e1d3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:07.775008 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a90c042f-3150-4b59-93b4-d93c49c7e1d3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:07.776257 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a90c042f-3150-4b59-93b4-d93c49c7e1d3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:07.776966 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a90c042f-3150-4b59-93b4-d93c49c7e1d3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:07.857959 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a90c042f-3150-4b59-93b4-d93c49c7e1d3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:07.872466 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a90c042f-3150-4b59-93b4-d93c49c7e1d3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1298 microversion: 2.1 time: 0.111130 Jun 27 21:18:07.873705 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 144/279] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:07 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1298 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:08.556119 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-62317319-0155-442e-b885-c975cdcfcfe5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:08.556747 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-62317319-0155-442e-b885-c975cdcfcfe5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:08.568814 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62317319-0155-442e-b885-c975cdcfcfe5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:08.569916 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62317319-0155-442e-b885-c975cdcfcfe5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:08.571165 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62317319-0155-442e-b885-c975cdcfcfe5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:08.571775 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62317319-0155-442e-b885-c975cdcfcfe5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:08.759037 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-62317319-0155-442e-b885-c975cdcfcfe5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:08.778336 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-62317319-0155-442e-b885-c975cdcfcfe5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1724 microversion: 2.1 time: 0.226495 Jun 27 21:18:08.780356 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 136/280] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:08 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:08.782051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f900cf8e-feda-41d4-b0fc-2b35ecca624c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-42587662", "imageRef": "3155f228-b1ff-487e-837f-85eec68c250a", "flavorRef": "452"}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:08.845143 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.network.neutron [None req-f900cf8e-feda-41d4-b0fc-2b35ecca624c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] validate_networks() for None {{(pid=117891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:18:08.893475 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-57aff0cc-33b7-4aeb-b171-b6397f0364b5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:08.894214 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-57aff0cc-33b7-4aeb-b171-b6397f0364b5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:08.901950 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57aff0cc-33b7-4aeb-b171-b6397f0364b5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:08.902759 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57aff0cc-33b7-4aeb-b171-b6397f0364b5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:08.903643 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57aff0cc-33b7-4aeb-b171-b6397f0364b5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:08.904150 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57aff0cc-33b7-4aeb-b171-b6397f0364b5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:09.002869 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-57aff0cc-33b7-4aeb-b171-b6397f0364b5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:09.012789 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-57aff0cc-33b7-4aeb-b171-b6397f0364b5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1304 microversion: 2.1 time: 0.124384 Jun 27 21:18:09.017247 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 137/281] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:08 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1304 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:09.409612 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0689c5b1-2483-453b-a82f-ce3f4031d498 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:09.410402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0689c5b1-2483-453b-a82f-ce3f4031d498 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:09.420687 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0689c5b1-2483-453b-a82f-ce3f4031d498 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:09.421181 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0689c5b1-2483-453b-a82f-ce3f4031d498 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:09.421978 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0689c5b1-2483-453b-a82f-ce3f4031d498 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:09.422413 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0689c5b1-2483-453b-a82f-ce3f4031d498 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:09.451541 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-0689c5b1-2483-453b-a82f-ce3f4031d498 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lazy-loading 'flavor' on Instance uuid 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:18:09.557894 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-f900cf8e-feda-41d4-b0fc-2b35ecca624c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Flavor limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:18:09.559889 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-f900cf8e-feda-41d4-b0fc-2b35ecca624c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Image limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:18:09.561036 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-f900cf8e-feda-41d4-b0fc-2b35ecca624c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Flavor pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:18:09.561806 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-f900cf8e-feda-41d4-b0fc-2b35ecca624c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Image pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:18:09.562466 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-f900cf8e-feda-41d4-b0fc-2b35ecca624c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:18:09.597180 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f900cf8e-feda-41d4-b0fc-2b35ecca624c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:09.598038 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f900cf8e-feda-41d4-b0fc-2b35ecca624c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:09.599434 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f900cf8e-feda-41d4-b0fc-2b35ecca624c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:09.600161 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f900cf8e-feda-41d4-b0fc-2b35ecca624c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:09.632529 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-f900cf8e-feda-41d4-b0fc-2b35ecca624c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Getting quotas for project fe9e09a9ddb84c7ea356c7df622281da. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:18:09.639691 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-f900cf8e-feda-41d4-b0fc-2b35ecca624c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Getting quotas for user 40ebda0ab7d045ce92da3d5512f30eaa and project fe9e09a9ddb84c7ea356c7df622281da. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:18:09.659854 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f900cf8e-feda-41d4-b0fc-2b35ecca624c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Going to run 1 instances... {{(pid=117891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:18:09.666748 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f900cf8e-feda-41d4-b0fc-2b35ecca624c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] [instance: c75c0a0d-ba4c-4f60-8cfd-427581097267] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3155f228-b1ff-487e-837f-85eec68c250a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:18:09.762805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f900cf8e-feda-41d4-b0fc-2b35ecca624c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.984575 Jun 27 21:18:09.764047 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 145/282] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 27 21:18:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 21:18:09.780904 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-bc1d97cd-8d70-499b-877f-37760dfdb6e5 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:09.781781 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-bc1d97cd-8d70-499b-877f-37760dfdb6e5 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] [instance: c75c0a0d-ba4c-4f60-8cfd-427581097267] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:09.843538 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0689c5b1-2483-453b-a82f-ce3f4031d498 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "POST /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1/action" status: 202 len: 0 microversion: 2.20 time: 0.438179 Jun 27 21:18:09.846551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 138/283] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jun 27 21:18:09 2022] POST /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:18:09.858951 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-478ae8c2-2b61-4b0c-bdaf-5f53551b5245 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:09.860850 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-478ae8c2-2b61-4b0c-bdaf-5f53551b5245 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:09.877701 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-478ae8c2-2b61-4b0c-bdaf-5f53551b5245 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:09.878763 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-478ae8c2-2b61-4b0c-bdaf-5f53551b5245 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:09.882149 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-478ae8c2-2b61-4b0c-bdaf-5f53551b5245 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:09.882818 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-478ae8c2-2b61-4b0c-bdaf-5f53551b5245 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:09.883650 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-bc1d97cd-8d70-499b-877f-37760dfdb6e5 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ebda0ab7d045ce92da3d5512f30eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e09a9ddb84c7ea356c7df622281da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:09.894640 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-bc1d97cd-8d70-499b-877f-37760dfdb6e5 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] 10.222.0.13 "GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267" status: 200 len: 1213 microversion: 2.1 time: 0.119045 Jun 27 21:18:09.897376 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 146/284] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:09 2022] GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267 => generated 1213 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:18:09.909861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8bcda6be-a87f-49da-a0a0-6f4479432cc6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:09.910727 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-8bcda6be-a87f-49da-a0a0-6f4479432cc6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:09.921765 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8bcda6be-a87f-49da-a0a0-6f4479432cc6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:09.924540 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8bcda6be-a87f-49da-a0a0-6f4479432cc6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:09.928783 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8bcda6be-a87f-49da-a0a0-6f4479432cc6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:09.932834 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8bcda6be-a87f-49da-a0a0-6f4479432cc6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:10.158030 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-478ae8c2-2b61-4b0c-bdaf-5f53551b5245 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:10.171006 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-478ae8c2-2b61-4b0c-bdaf-5f53551b5245 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1724 microversion: 2.1 time: 0.321331 Jun 27 21:18:10.171953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 139/285] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:09 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:10.184898 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cbf41c02-90c0-44a2-b21c-b885b0874fa6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:10.189580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cbf41c02-90c0-44a2-b21c-b885b0874fa6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:10.203926 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cbf41c02-90c0-44a2-b21c-b885b0874fa6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:10.204966 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cbf41c02-90c0-44a2-b21c-b885b0874fa6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:10.206652 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cbf41c02-90c0-44a2-b21c-b885b0874fa6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:10.207621 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cbf41c02-90c0-44a2-b21c-b885b0874fa6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:10.230658 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8bcda6be-a87f-49da-a0a0-6f4479432cc6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:10.241470 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8bcda6be-a87f-49da-a0a0-6f4479432cc6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:10.243971 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8bcda6be-a87f-49da-a0a0-6f4479432cc6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:10.246745 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8bcda6be-a87f-49da-a0a0-6f4479432cc6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1722 microversion: 2.20 time: 0.344947 Jun 27 21:18:10.257220 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 147/286] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:09 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1722 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:10.481759 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cbf41c02-90c0-44a2-b21c-b885b0874fa6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:10.494404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cbf41c02-90c0-44a2-b21c-b885b0874fa6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1371 microversion: 2.1 time: 0.320949 Jun 27 21:18:10.495677 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 140/287] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:10 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1371 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:10.933221 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-179fc4f9-764c-4f8a-be88-57d5ffc1afac tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:10.938281 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-179fc4f9-764c-4f8a-be88-57d5ffc1afac tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] [instance: c75c0a0d-ba4c-4f60-8cfd-427581097267] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:10.955974 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-179fc4f9-764c-4f8a-be88-57d5ffc1afac tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:10.957148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-179fc4f9-764c-4f8a-be88-57d5ffc1afac tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:10.958033 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-179fc4f9-764c-4f8a-be88-57d5ffc1afac tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:10.958541 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-179fc4f9-764c-4f8a-be88-57d5ffc1afac tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:11.009031 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6b19e7f5-74e7-482a-b820-7131f7fbb484 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Action: 'create', calling method: .version_select at 0x7f835443e5e0>, body: {"keypair": {"name": "tempest-keypair-863592044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7Evh0fFqzxyAtQLaYziE6T7q2l+Rxisn95A/WSSkg16DaE0NssS/Yefo+mbHtYnfXDHyeAEMndasy7c5/1gcseF4LELV8DkrH5+Udmm5fKElsqAQZJfNqguwtIP8b4Yw=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:11.033705 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-6b19e7f5-74e7-482a-b820-7131f7fbb484 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Getting quotas for project 4a74724882c84e8f893f5be0f59a9581. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:18:11.038683 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-6b19e7f5-74e7-482a-b820-7131f7fbb484 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Getting quotas for user fff9f1fc84a54b83a7a384965f40c9d9 and project 4a74724882c84e8f893f5be0f59a9581. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:18:11.062605 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-179fc4f9-764c-4f8a-be88-57d5ffc1afac tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ebda0ab7d045ce92da3d5512f30eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e09a9ddb84c7ea356c7df622281da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:11.068873 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6b19e7f5-74e7-482a-b820-7131f7fbb484 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.063106 Jun 27 21:18:11.069945 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 141/288] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 27 21:18:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:18:11.077749 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-179fc4f9-764c-4f8a-be88-57d5ffc1afac tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] 10.222.0.13 "GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267" status: 200 len: 1265 microversion: 2.1 time: 0.163370 Jun 27 21:18:11.078940 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 148/289] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:10 2022] GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:11.190433 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1bb886f5-7de8-4211-bacd-4872ce7fe6aa tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:11.191257 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1bb886f5-7de8-4211-bacd-4872ce7fe6aa tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:11.206487 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1bb886f5-7de8-4211-bacd-4872ce7fe6aa tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:11.207129 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1bb886f5-7de8-4211-bacd-4872ce7fe6aa tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:11.208487 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1bb886f5-7de8-4211-bacd-4872ce7fe6aa tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:11.209897 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1bb886f5-7de8-4211-bacd-4872ce7fe6aa tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:11.260352 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-801ec6c9-14a5-43df-96bf-befafc307edf req-343e87d9-a13d-4251-b7b0-1a3793e432f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a1409c2-ecfa-4ed4-b547-aa5667367e5d", "tag": "b9348a43-0456-47cf-97ba-a8ab01ba6107"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:11.299639 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-801ec6c9-14a5-43df-96bf-befafc307edf req-343e87d9-a13d-4251-b7b0-1a3793e432f7 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:11.309527 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-801ec6c9-14a5-43df-96bf-befafc307edf req-343e87d9-a13d-4251-b7b0-1a3793e432f7 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:11.346067 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-801ec6c9-14a5-43df-96bf-befafc307edf req-343e87d9-a13d-4251-b7b0-1a3793e432f7 service nova] Creating event network-changed:b9348a43-0456-47cf-97ba-a8ab01ba6107 for instance 3a1409c2-ecfa-4ed4-b547-aa5667367e5d on hv-cinder-84773 Jun 27 21:18:11.353260 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-801ec6c9-14a5-43df-96bf-befafc307edf req-343e87d9-a13d-4251-b7b0-1a3793e432f7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114440 Jun 27 21:18:11.354581 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 149/290] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:18:11.363811 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b3dcdfe1-ea3f-4f8f-a8d1-d20aba2eb805 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:11.365971 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b3dcdfe1-ea3f-4f8f-a8d1-d20aba2eb805 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:11.382107 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b3dcdfe1-ea3f-4f8f-a8d1-d20aba2eb805 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:11.382653 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b3dcdfe1-ea3f-4f8f-a8d1-d20aba2eb805 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:11.383979 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b3dcdfe1-ea3f-4f8f-a8d1-d20aba2eb805 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:11.384635 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b3dcdfe1-ea3f-4f8f-a8d1-d20aba2eb805 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:11.640113 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1bb886f5-7de8-4211-bacd-4872ce7fe6aa tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:11.649342 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1bb886f5-7de8-4211-bacd-4872ce7fe6aa tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1724 microversion: 2.1 time: 0.463364 Jun 27 21:18:11.650199 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 142/291] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:11 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1724 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:18:11.669617 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bf7abcb8-6a28-49d4-ab20-3338b0547ad5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:11.671336 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bf7abcb8-6a28-49d4-ab20-3338b0547ad5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:11.682385 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf7abcb8-6a28-49d4-ab20-3338b0547ad5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:11.682864 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf7abcb8-6a28-49d4-ab20-3338b0547ad5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:11.683951 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf7abcb8-6a28-49d4-ab20-3338b0547ad5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:11.684445 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf7abcb8-6a28-49d4-ab20-3338b0547ad5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:11.716573 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:11.758017 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b3dcdfe1-ea3f-4f8f-a8d1-d20aba2eb805 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:11.767523 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b3dcdfe1-ea3f-4f8f-a8d1-d20aba2eb805 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:11.770202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b3dcdfe1-ea3f-4f8f-a8d1-d20aba2eb805 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:11.771815 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b3dcdfe1-ea3f-4f8f-a8d1-d20aba2eb805 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1722 microversion: 2.20 time: 0.415651 Jun 27 21:18:11.777902 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 150/292] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:11 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1722 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:11.959000 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bf7abcb8-6a28-49d4-ab20-3338b0547ad5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:11.969452 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bf7abcb8-6a28-49d4-ab20-3338b0547ad5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1371 microversion: 2.1 time: 0.317931 Jun 27 21:18:11.970191 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 143/293] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:11 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1371 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:12.097882 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9f77e6d7-d477-4bcb-84dd-281aba2850b0 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:12.099051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9f77e6d7-d477-4bcb-84dd-281aba2850b0 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] [instance: c75c0a0d-ba4c-4f60-8cfd-427581097267] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:12.107170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9f77e6d7-d477-4bcb-84dd-281aba2850b0 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:12.107618 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9f77e6d7-d477-4bcb-84dd-281aba2850b0 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:12.108559 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9f77e6d7-d477-4bcb-84dd-281aba2850b0 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:12.109223 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9f77e6d7-d477-4bcb-84dd-281aba2850b0 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:12.114668 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:12.198499 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9f77e6d7-d477-4bcb-84dd-281aba2850b0 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ebda0ab7d045ce92da3d5512f30eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e09a9ddb84c7ea356c7df622281da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:12.209754 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9f77e6d7-d477-4bcb-84dd-281aba2850b0 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] 10.222.0.13 "GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267" status: 200 len: 1271 microversion: 2.1 time: 0.116894 Jun 27 21:18:12.217445 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 151/294] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:12 2022] GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267 => generated 1271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:12.670571 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5b026c94-fd47-4c85-a610-a1f87cabccd3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:12.671327 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5b026c94-fd47-4c85-a610-a1f87cabccd3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:12.679417 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5b026c94-fd47-4c85-a610-a1f87cabccd3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:12.679949 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5b026c94-fd47-4c85-a610-a1f87cabccd3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:12.681906 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5b026c94-fd47-4c85-a610-a1f87cabccd3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:12.682660 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5b026c94-fd47-4c85-a610-a1f87cabccd3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:12.798434 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-544f033e-c54f-4534-80ea-1482bf84b440 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:12.799315 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-544f033e-c54f-4534-80ea-1482bf84b440 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:12.802803 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:12.812328 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-544f033e-c54f-4534-80ea-1482bf84b440 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:12.813326 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-544f033e-c54f-4534-80ea-1482bf84b440 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:12.814498 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-544f033e-c54f-4534-80ea-1482bf84b440 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:12.815341 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-544f033e-c54f-4534-80ea-1482bf84b440 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:12.973295 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-544f033e-c54f-4534-80ea-1482bf84b440 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:12.986494 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-544f033e-c54f-4534-80ea-1482bf84b440 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:12.988289 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-544f033e-c54f-4534-80ea-1482bf84b440 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:12.989530 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-544f033e-c54f-4534-80ea-1482bf84b440 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1722 microversion: 2.20 time: 0.196694 Jun 27 21:18:12.990259 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 152/295] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:12 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:12.995737 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-eec22545-804b-4115-b4f4-3cf24e839d80 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:12.996370 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-eec22545-804b-4115-b4f4-3cf24e839d80 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:13.003856 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-eec22545-804b-4115-b4f4-3cf24e839d80 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:13.004370 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-eec22545-804b-4115-b4f4-3cf24e839d80 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:13.005288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-eec22545-804b-4115-b4f4-3cf24e839d80 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:13.005722 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-eec22545-804b-4115-b4f4-3cf24e839d80 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:13.034944 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5b026c94-fd47-4c85-a610-a1f87cabccd3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:13.047341 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5b026c94-fd47-4c85-a610-a1f87cabccd3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1724 microversion: 2.1 time: 0.382352 Jun 27 21:18:13.048027 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 144/296] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:12 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1724 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:13.175059 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-eec22545-804b-4115-b4f4-3cf24e839d80 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:13.185899 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-eec22545-804b-4115-b4f4-3cf24e839d80 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1371 microversion: 2.1 time: 0.194464 Jun 27 21:18:13.186492 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 153/297] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:12 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:13.229918 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6cac5976-b7d3-4395-8cf1-81e3d6850872 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:13.233177 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6cac5976-b7d3-4395-8cf1-81e3d6850872 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] [instance: c75c0a0d-ba4c-4f60-8cfd-427581097267] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:13.239386 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6cac5976-b7d3-4395-8cf1-81e3d6850872 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:13.240047 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6cac5976-b7d3-4395-8cf1-81e3d6850872 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:13.240879 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6cac5976-b7d3-4395-8cf1-81e3d6850872 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:13.241509 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6cac5976-b7d3-4395-8cf1-81e3d6850872 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:13.574718 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6cac5976-b7d3-4395-8cf1-81e3d6850872 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ebda0ab7d045ce92da3d5512f30eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e09a9ddb84c7ea356c7df622281da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:13.585705 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6cac5976-b7d3-4395-8cf1-81e3d6850872 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] 10.222.0.13 "GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267" status: 200 len: 1313 microversion: 2.1 time: 0.359639 Jun 27 21:18:13.589170 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 145/298] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:13 2022] GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267 => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:18:14.012638 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a02c6405-f83a-4165-80d8-9efd9f14178c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:14.013680 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a02c6405-f83a-4165-80d8-9efd9f14178c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:14.026515 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a02c6405-f83a-4165-80d8-9efd9f14178c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:14.027328 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a02c6405-f83a-4165-80d8-9efd9f14178c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:14.028567 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a02c6405-f83a-4165-80d8-9efd9f14178c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:14.029375 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a02c6405-f83a-4165-80d8-9efd9f14178c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:14.069283 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fb4e7549-255b-4278-ad64-f552ec9edd74 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:14.070151 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fb4e7549-255b-4278-ad64-f552ec9edd74 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:14.083480 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb4e7549-255b-4278-ad64-f552ec9edd74 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:14.084810 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb4e7549-255b-4278-ad64-f552ec9edd74 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:14.087388 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb4e7549-255b-4278-ad64-f552ec9edd74 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:14.088299 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb4e7549-255b-4278-ad64-f552ec9edd74 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:14.225798 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a02c6405-f83a-4165-80d8-9efd9f14178c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:14.235303 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a02c6405-f83a-4165-80d8-9efd9f14178c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:14.237253 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a02c6405-f83a-4165-80d8-9efd9f14178c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:14.238557 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a02c6405-f83a-4165-80d8-9efd9f14178c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1722 microversion: 2.20 time: 0.232183 Jun 27 21:18:14.239371 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 154/299] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:14 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:14.244309 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a1d78e9e-7fbd-47ea-b2e0-8104d68e4068 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:14.245030 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a1d78e9e-7fbd-47ea-b2e0-8104d68e4068 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:14.251541 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a1d78e9e-7fbd-47ea-b2e0-8104d68e4068 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:14.252092 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a1d78e9e-7fbd-47ea-b2e0-8104d68e4068 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:14.253010 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a1d78e9e-7fbd-47ea-b2e0-8104d68e4068 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:14.253837 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a1d78e9e-7fbd-47ea-b2e0-8104d68e4068 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:14.444048 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a1d78e9e-7fbd-47ea-b2e0-8104d68e4068 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:14.452706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a1d78e9e-7fbd-47ea-b2e0-8104d68e4068 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1371 microversion: 2.1 time: 0.212023 Jun 27 21:18:14.463217 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fb4e7549-255b-4278-ad64-f552ec9edd74 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:14.464578 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 155/300] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:14 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:14.466536 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fb4e7549-255b-4278-ad64-f552ec9edd74 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1724 microversion: 2.1 time: 0.404211 Jun 27 21:18:14.467378 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 146/301] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:14 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1724 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:14.574283 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d25d4791-79fb-4c78-9d25-2b921f714978 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1148813134", "imageRef": "3155f228-b1ff-487e-837f-85eec68c250a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88eac9a2-e4a8-414f-a6be-c486870814c1"}], "security_groups": [{"name": "tempest-securitygroup--1659661199"}], "key_name": "tempest-keypair-863592044", "user_data": "}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:14.610346 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4480b873-91fd-42ef-8c58-0a8ae08d968d tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:14.610990 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4480b873-91fd-42ef-8c58-0a8ae08d968d tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] [instance: c75c0a0d-ba4c-4f60-8cfd-427581097267] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:14.620246 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4480b873-91fd-42ef-8c58-0a8ae08d968d tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:14.620875 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4480b873-91fd-42ef-8c58-0a8ae08d968d tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:14.622899 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4480b873-91fd-42ef-8c58-0a8ae08d968d tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:14.623345 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4480b873-91fd-42ef-8c58-0a8ae08d968d tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:14.707927 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.network.neutron [None req-d25d4791-79fb-4c78-9d25-2b921f714978 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] validate_networks() for [('88eac9a2-e4a8-414f-a6be-c486870814c1', None, None, None, None, None)] {{(pid=117891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:18:14.893924 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4480b873-91fd-42ef-8c58-0a8ae08d968d tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ebda0ab7d045ce92da3d5512f30eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e09a9ddb84c7ea356c7df622281da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:14.902708 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4480b873-91fd-42ef-8c58-0a8ae08d968d tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] 10.222.0.13 "GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267" status: 200 len: 1313 microversion: 2.1 time: 0.298216 Jun 27 21:18:14.903695 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 147/302] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:14 2022] GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267 => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:18:14.912995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-0ea7b236-7ada-405e-9dad-7cd1e8417b77 req-e869c75b-59f2-46ad-99ea-831dd5188f57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c75c0a0d-ba4c-4f60-8cfd-427581097267", "tag": "e8262eaa-95f7-4e78-8938-ee6bbcfd541b"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:14.951460 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-0ea7b236-7ada-405e-9dad-7cd1e8417b77 req-e869c75b-59f2-46ad-99ea-831dd5188f57 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:14.952041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-0ea7b236-7ada-405e-9dad-7cd1e8417b77 req-e869c75b-59f2-46ad-99ea-831dd5188f57 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:14.969743 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-0ea7b236-7ada-405e-9dad-7cd1e8417b77 req-e869c75b-59f2-46ad-99ea-831dd5188f57 service nova] Creating event network-changed:e8262eaa-95f7-4e78-8938-ee6bbcfd541b for instance c75c0a0d-ba4c-4f60-8cfd-427581097267 on hv-cinder-84773 Jun 27 21:18:14.975752 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-0ea7b236-7ada-405e-9dad-7cd1e8417b77 req-e869c75b-59f2-46ad-99ea-831dd5188f57 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070644 Jun 27 21:18:14.977268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 148/303] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:18:14.983535 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4788ae68-ee84-47b7-a347-414d8f86c301 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1149163633", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1869209914", "security_groups": [{"name": "tempest-secgroup-smoke-930866790"}], "networks": [{"uuid": "2833602c-5fda-49c5-9f8b-40525401a7af"}], "block_device_mapping_v2": [{"uuid": "ae11631c-5611-4eb5-a889-037ceddf3a3a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:15.161286 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-4788ae68-ee84-47b7-a347-414d8f86c301 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] validate_networks() for [('2833602c-5fda-49c5-9f8b-40525401a7af', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:18:15.242135 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-d25d4791-79fb-4c78-9d25-2b921f714978 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Flavor limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:18:15.242997 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-d25d4791-79fb-4c78-9d25-2b921f714978 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Image limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:18:15.243506 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-d25d4791-79fb-4c78-9d25-2b921f714978 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Flavor pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:18:15.244158 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-d25d4791-79fb-4c78-9d25-2b921f714978 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Image pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:18:15.244730 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-d25d4791-79fb-4c78-9d25-2b921f714978 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:18:15.256879 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d25d4791-79fb-4c78-9d25-2b921f714978 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:15.257433 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d25d4791-79fb-4c78-9d25-2b921f714978 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:15.258221 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d25d4791-79fb-4c78-9d25-2b921f714978 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:15.258698 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d25d4791-79fb-4c78-9d25-2b921f714978 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:15.277908 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-d25d4791-79fb-4c78-9d25-2b921f714978 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Getting quotas for project 4a74724882c84e8f893f5be0f59a9581. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:18:15.282840 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-d25d4791-79fb-4c78-9d25-2b921f714978 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Getting quotas for user fff9f1fc84a54b83a7a384965f40c9d9 and project 4a74724882c84e8f893f5be0f59a9581. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:18:15.295743 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d25d4791-79fb-4c78-9d25-2b921f714978 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Going to run 1 instances... {{(pid=117891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:18:15.298493 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d25d4791-79fb-4c78-9d25-2b921f714978 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3155f228-b1ff-487e-837f-85eec68c250a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:18:15.349986 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d25d4791-79fb-4c78-9d25-2b921f714978 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.783846 Jun 27 21:18:15.351216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 156/304] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 27 21:18:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 21:18:15.356258 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-28078c9f-465d-40f6-b7af-6e0d2aedc593 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:15.357285 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-28078c9f-465d-40f6-b7af-6e0d2aedc593 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:15.364562 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-28078c9f-465d-40f6-b7af-6e0d2aedc593 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:15.365258 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-28078c9f-465d-40f6-b7af-6e0d2aedc593 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:15.366134 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-28078c9f-465d-40f6-b7af-6e0d2aedc593 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:15.366654 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-28078c9f-465d-40f6-b7af-6e0d2aedc593 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:15.564038 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-28078c9f-465d-40f6-b7af-6e0d2aedc593 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:15.577889 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-28078c9f-465d-40f6-b7af-6e0d2aedc593 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:15.580989 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-28078c9f-465d-40f6-b7af-6e0d2aedc593 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:15.583487 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-28078c9f-465d-40f6-b7af-6e0d2aedc593 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1722 microversion: 2.20 time: 0.231325 Jun 27 21:18:15.584235 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 157/305] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:15 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:15.592286 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6dd9b0a2-8255-46d8-a0d8-971a85fa5cff tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:15.593458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6dd9b0a2-8255-46d8-a0d8-971a85fa5cff tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:15.669435 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-6dd9b0a2-8255-46d8-a0d8-971a85fa5cff tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:15.679272 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6dd9b0a2-8255-46d8-a0d8-971a85fa5cff tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2" status: 200 len: 1241 microversion: 2.1 time: 0.093739 Jun 27 21:18:15.694249 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 158/306] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:15 2022] GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 => generated 1241 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:15.710256 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6faa68a9-edcd-4d70-8fef-d2b7ac190c8c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:15.714581 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6faa68a9-edcd-4d70-8fef-d2b7ac190c8c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:15.729460 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6faa68a9-edcd-4d70-8fef-d2b7ac190c8c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:15.730149 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6faa68a9-edcd-4d70-8fef-d2b7ac190c8c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:15.731864 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6faa68a9-edcd-4d70-8fef-d2b7ac190c8c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:15.732608 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6faa68a9-edcd-4d70-8fef-d2b7ac190c8c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:15.811735 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-4788ae68-ee84-47b7-a347-414d8f86c301 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:18:15.812449 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-4788ae68-ee84-47b7-a347-414d8f86c301 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:18:15.813379 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-4788ae68-ee84-47b7-a347-414d8f86c301 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:18:15.813799 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-4788ae68-ee84-47b7-a347-414d8f86c301 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:18:15.814292 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-4788ae68-ee84-47b7-a347-414d8f86c301 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:18:15.832657 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4788ae68-ee84-47b7-a347-414d8f86c301 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:15.833181 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4788ae68-ee84-47b7-a347-414d8f86c301 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:15.834015 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4788ae68-ee84-47b7-a347-414d8f86c301 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:15.834540 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4788ae68-ee84-47b7-a347-414d8f86c301 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:15.861246 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-4788ae68-ee84-47b7-a347-414d8f86c301 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Getting quotas for project f484976e63ce44daa10eadd2a9d6cc76. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:18:15.867295 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-4788ae68-ee84-47b7-a347-414d8f86c301 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Getting quotas for user 4e8428365f1148a2934dd4596deeb43a and project f484976e63ce44daa10eadd2a9d6cc76. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:18:15.933999 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-6faa68a9-edcd-4d70-8fef-d2b7ac190c8c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:15.942331 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6faa68a9-edcd-4d70-8fef-d2b7ac190c8c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1371 microversion: 2.1 time: 0.243466 Jun 27 21:18:15.942935 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 159/307] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:15 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:15.947906 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2b936a69-35ac-4cf4-8a3f-62adb376366a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:15.948527 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2b936a69-35ac-4cf4-8a3f-62adb376366a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:15.952021 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4788ae68-ee84-47b7-a347-414d8f86c301 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:18:15.954363 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4788ae68-ee84-47b7-a347-414d8f86c301 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae11631c-5611-4eb5-a889-037ceddf3a3a',volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:18:15.958913 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2b936a69-35ac-4cf4-8a3f-62adb376366a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:15.959369 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2b936a69-35ac-4cf4-8a3f-62adb376366a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:15.960148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2b936a69-35ac-4cf4-8a3f-62adb376366a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:15.960577 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2b936a69-35ac-4cf4-8a3f-62adb376366a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:16.125456 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4788ae68-ee84-47b7-a347-414d8f86c301 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.146351 Jun 27 21:18:16.126549 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 149/308] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 27 21:18:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 1148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:18:16.132287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5d3d55bc-3a53-4758-b86f-6fbe5376bf3a tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:16.133036 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5d3d55bc-3a53-4758-b86f-6fbe5376bf3a tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] [instance: c75c0a0d-ba4c-4f60-8cfd-427581097267] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:16.134374 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2b936a69-35ac-4cf4-8a3f-62adb376366a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:16.140435 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d3d55bc-3a53-4758-b86f-6fbe5376bf3a tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:16.140884 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d3d55bc-3a53-4758-b86f-6fbe5376bf3a tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:16.141700 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d3d55bc-3a53-4758-b86f-6fbe5376bf3a tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:16.142133 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d3d55bc-3a53-4758-b86f-6fbe5376bf3a tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:16.144141 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2b936a69-35ac-4cf4-8a3f-62adb376366a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1724 microversion: 2.1 time: 0.200146 Jun 27 21:18:16.144836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 160/309] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:15 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:16.150484 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b0265c03-3d9e-4ece-93d7-deea3d41fbc0 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:16.151228 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b0265c03-3d9e-4ece-93d7-deea3d41fbc0 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:16.217813 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b0265c03-3d9e-4ece-93d7-deea3d41fbc0 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:16.226120 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b0265c03-3d9e-4ece-93d7-deea3d41fbc0 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1089 microversion: 2.1 time: 0.080019 Jun 27 21:18:16.226802 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 161/310] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:16 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1089 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:16.315167 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5d3d55bc-3a53-4758-b86f-6fbe5376bf3a tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ebda0ab7d045ce92da3d5512f30eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e09a9ddb84c7ea356c7df622281da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:16.324396 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5d3d55bc-3a53-4758-b86f-6fbe5376bf3a tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] 10.222.0.13 "GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267" status: 200 len: 1313 microversion: 2.1 time: 0.196445 Jun 27 21:18:16.324972 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 150/311] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:16 2022] GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:16.605263 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1ebd0fd3-6122-4ae5-8639-7d301cf939dc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:16.605978 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1ebd0fd3-6122-4ae5-8639-7d301cf939dc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:16.612617 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1ebd0fd3-6122-4ae5-8639-7d301cf939dc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:16.613188 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1ebd0fd3-6122-4ae5-8639-7d301cf939dc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:16.614039 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1ebd0fd3-6122-4ae5-8639-7d301cf939dc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:16.614643 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1ebd0fd3-6122-4ae5-8639-7d301cf939dc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:16.699186 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ca6db3e1-2648-48ca-a3a2-bc3c9b3f30c5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:16.699906 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ca6db3e1-2648-48ca-a3a2-bc3c9b3f30c5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:16.710955 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ca6db3e1-2648-48ca-a3a2-bc3c9b3f30c5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:16.711413 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ca6db3e1-2648-48ca-a3a2-bc3c9b3f30c5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:16.715568 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ca6db3e1-2648-48ca-a3a2-bc3c9b3f30c5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:16.723689 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ca6db3e1-2648-48ca-a3a2-bc3c9b3f30c5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:16.821594 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1ebd0fd3-6122-4ae5-8639-7d301cf939dc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:16.832070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1ebd0fd3-6122-4ae5-8639-7d301cf939dc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:16.834305 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1ebd0fd3-6122-4ae5-8639-7d301cf939dc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:16.835540 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1ebd0fd3-6122-4ae5-8639-7d301cf939dc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1722 microversion: 2.20 time: 0.234922 Jun 27 21:18:16.836834 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 162/312] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:16 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:16.846222 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ca6db3e1-2648-48ca-a3a2-bc3c9b3f30c5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:16.859574 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ca6db3e1-2648-48ca-a3a2-bc3c9b3f30c5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2" status: 200 len: 1237 microversion: 2.1 time: 0.163756 Jun 27 21:18:16.860740 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 151/313] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:16 2022] GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 => generated 1237 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:16.965462 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1b67e629-9b50-4909-b5a6-f48bca1b6e4c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:16.966228 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1b67e629-9b50-4909-b5a6-f48bca1b6e4c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:16.974154 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1b67e629-9b50-4909-b5a6-f48bca1b6e4c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:16.974944 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1b67e629-9b50-4909-b5a6-f48bca1b6e4c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:16.975684 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1b67e629-9b50-4909-b5a6-f48bca1b6e4c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:16.976122 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1b67e629-9b50-4909-b5a6-f48bca1b6e4c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:17.126575 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1b67e629-9b50-4909-b5a6-f48bca1b6e4c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:17.135103 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1b67e629-9b50-4909-b5a6-f48bca1b6e4c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1371 microversion: 2.1 time: 0.175261 Jun 27 21:18:17.135853 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 163/314] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:16 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:17.164478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a2b412a7-257d-4fbb-be05-d48e0a87abfe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:17.165130 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a2b412a7-257d-4fbb-be05-d48e0a87abfe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:17.172290 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a2b412a7-257d-4fbb-be05-d48e0a87abfe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:17.172736 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a2b412a7-257d-4fbb-be05-d48e0a87abfe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:17.173558 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a2b412a7-257d-4fbb-be05-d48e0a87abfe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:17.173989 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a2b412a7-257d-4fbb-be05-d48e0a87abfe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:17.245210 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-37fe03dd-fa1b-4055-8ebc-f6b19993ff74 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:17.245841 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-37fe03dd-fa1b-4055-8ebc-f6b19993ff74 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:17.255012 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-37fe03dd-fa1b-4055-8ebc-f6b19993ff74 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:17.255531 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-37fe03dd-fa1b-4055-8ebc-f6b19993ff74 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:17.256375 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-37fe03dd-fa1b-4055-8ebc-f6b19993ff74 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:17.256833 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-37fe03dd-fa1b-4055-8ebc-f6b19993ff74 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:17.340815 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-37fe03dd-fa1b-4055-8ebc-f6b19993ff74 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:17.349299 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-37fe03dd-fa1b-4055-8ebc-f6b19993ff74 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1187 microversion: 2.1 time: 0.108196 Jun 27 21:18:17.349946 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 164/315] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:17 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1187 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:17.356031 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0dc0eddf-fefd-4eea-8995-45a031dbcf57 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:17.356911 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0dc0eddf-fefd-4eea-8995-45a031dbcf57 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] [instance: c75c0a0d-ba4c-4f60-8cfd-427581097267] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:17.363916 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0dc0eddf-fefd-4eea-8995-45a031dbcf57 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:17.365525 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0dc0eddf-fefd-4eea-8995-45a031dbcf57 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:17.366940 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0dc0eddf-fefd-4eea-8995-45a031dbcf57 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:17.367607 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0dc0eddf-fefd-4eea-8995-45a031dbcf57 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:17.375964 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a2b412a7-257d-4fbb-be05-d48e0a87abfe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:17.391994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a2b412a7-257d-4fbb-be05-d48e0a87abfe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1724 microversion: 2.1 time: 0.231794 Jun 27 21:18:17.392967 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 152/316] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:17 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:17.569459 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0dc0eddf-fefd-4eea-8995-45a031dbcf57 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ebda0ab7d045ce92da3d5512f30eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e09a9ddb84c7ea356c7df622281da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:17.578835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0dc0eddf-fefd-4eea-8995-45a031dbcf57 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] 10.222.0.13 "GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267" status: 200 len: 1313 microversion: 2.1 time: 0.227561 Jun 27 21:18:17.579713 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 165/317] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:17 2022] GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:17.634702 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-face5c08-5fee-437a-99b1-81c45fba19de req-55b888b4-b8a1-4f5d-a01c-0e1e0c8e4b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a1409c2-ecfa-4ed4-b547-aa5667367e5d", "name": "network-vif-plugged", "status": "completed", "tag": "b9348a43-0456-47cf-97ba-a8ab01ba6107"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:17.644727 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-face5c08-5fee-437a-99b1-81c45fba19de req-55b888b4-b8a1-4f5d-a01c-0e1e0c8e4b47 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:17.645444 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-face5c08-5fee-437a-99b1-81c45fba19de req-55b888b4-b8a1-4f5d-a01c-0e1e0c8e4b47 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:17.659682 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-face5c08-5fee-437a-99b1-81c45fba19de req-55b888b4-b8a1-4f5d-a01c-0e1e0c8e4b47 service nova] Creating event network-vif-plugged:b9348a43-0456-47cf-97ba-a8ab01ba6107 for instance 3a1409c2-ecfa-4ed4-b547-aa5667367e5d on hv-cinder-84773 Jun 27 21:18:17.666081 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-face5c08-5fee-437a-99b1-81c45fba19de req-55b888b4-b8a1-4f5d-a01c-0e1e0c8e4b47 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035121 Jun 27 21:18:17.666903 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 153/318] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:18:17.865802 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9febc2f4-430f-4c76-a903-65d41789a917 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:17.869789 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9febc2f4-430f-4c76-a903-65d41789a917 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:17.881174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5fccb6c9-dbb6-4ac2-a383-c2d6c8d45318 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:17.882101 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5fccb6c9-dbb6-4ac2-a383-c2d6c8d45318 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:17.891105 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5fccb6c9-dbb6-4ac2-a383-c2d6c8d45318 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:17.891726 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5fccb6c9-dbb6-4ac2-a383-c2d6c8d45318 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:17.892018 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9febc2f4-430f-4c76-a903-65d41789a917 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:17.893081 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5fccb6c9-dbb6-4ac2-a383-c2d6c8d45318 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:17.894811 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5fccb6c9-dbb6-4ac2-a383-c2d6c8d45318 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:17.895596 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9febc2f4-430f-4c76-a903-65d41789a917 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:17.899337 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9febc2f4-430f-4c76-a903-65d41789a917 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:17.901103 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9febc2f4-430f-4c76-a903-65d41789a917 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:18.060866 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5fccb6c9-dbb6-4ac2-a383-c2d6c8d45318 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:18.070730 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5fccb6c9-dbb6-4ac2-a383-c2d6c8d45318 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2" status: 200 len: 1301 microversion: 2.1 time: 0.194438 Jun 27 21:18:18.072512 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 154/319] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:17 2022] GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 => generated 1301 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:18:18.152734 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-940fad34-f9b7-419f-ad38-b9da43cf4a98 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:18.154090 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-940fad34-f9b7-419f-ad38-b9da43cf4a98 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:18.168157 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-940fad34-f9b7-419f-ad38-b9da43cf4a98 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:18.168816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-940fad34-f9b7-419f-ad38-b9da43cf4a98 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:18.169971 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-940fad34-f9b7-419f-ad38-b9da43cf4a98 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:18.170627 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-940fad34-f9b7-419f-ad38-b9da43cf4a98 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:18.215454 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9febc2f4-430f-4c76-a903-65d41789a917 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:18.225142 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9febc2f4-430f-4c76-a903-65d41789a917 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:18.226924 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9febc2f4-430f-4c76-a903-65d41789a917 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:18.228344 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9febc2f4-430f-4c76-a903-65d41789a917 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1722 microversion: 2.20 time: 0.376129 Jun 27 21:18:18.228988 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 166/320] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:17 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1722 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:18:18.375308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-046ed0d9-ed29-4ab9-b024-7d54fe837f06 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:18.376019 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-046ed0d9-ed29-4ab9-b024-7d54fe837f06 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:18.376562 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-940fad34-f9b7-419f-ad38-b9da43cf4a98 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:18.384689 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-046ed0d9-ed29-4ab9-b024-7d54fe837f06 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:18.385434 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-046ed0d9-ed29-4ab9-b024-7d54fe837f06 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:18.389392 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-046ed0d9-ed29-4ab9-b024-7d54fe837f06 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:18.390303 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-046ed0d9-ed29-4ab9-b024-7d54fe837f06 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:18.398719 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-940fad34-f9b7-419f-ad38-b9da43cf4a98 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1371 microversion: 2.1 time: 0.249568 Jun 27 21:18:18.400471 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 155/321] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:18 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:18:18.411611 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e8cb5ceb-ea91-407c-a4ba-2362664b7f70 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:18.412381 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e8cb5ceb-ea91-407c-a4ba-2362664b7f70 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:18.416904 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:18.425729 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e8cb5ceb-ea91-407c-a4ba-2362664b7f70 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:18.426293 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e8cb5ceb-ea91-407c-a4ba-2362664b7f70 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:18.427225 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e8cb5ceb-ea91-407c-a4ba-2362664b7f70 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:18.427883 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e8cb5ceb-ea91-407c-a4ba-2362664b7f70 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:18.505360 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-046ed0d9-ed29-4ab9-b024-7d54fe837f06 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:18.514893 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-046ed0d9-ed29-4ab9-b024-7d54fe837f06 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1205 microversion: 2.1 time: 0.144735 Jun 27 21:18:18.515820 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 167/322] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:18 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1205 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:18:18.602142 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0a449021-dbb5-4a8f-b8a5-57bf5db9f96e tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:18.603051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0a449021-dbb5-4a8f-b8a5-57bf5db9f96e tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] [instance: c75c0a0d-ba4c-4f60-8cfd-427581097267] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:18.610302 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0a449021-dbb5-4a8f-b8a5-57bf5db9f96e tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:18.611083 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0a449021-dbb5-4a8f-b8a5-57bf5db9f96e tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:18.611857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0a449021-dbb5-4a8f-b8a5-57bf5db9f96e tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:18.612506 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0a449021-dbb5-4a8f-b8a5-57bf5db9f96e tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:18.620571 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e8cb5ceb-ea91-407c-a4ba-2362664b7f70 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:18.629772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e8cb5ceb-ea91-407c-a4ba-2362664b7f70 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1724 microversion: 2.1 time: 0.222678 Jun 27 21:18:18.631218 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 156/323] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:18 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:18.845494 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0a449021-dbb5-4a8f-b8a5-57bf5db9f96e tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ebda0ab7d045ce92da3d5512f30eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e09a9ddb84c7ea356c7df622281da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:18.876317 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0a449021-dbb5-4a8f-b8a5-57bf5db9f96e tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] 10.222.0.13 "GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267" status: 200 len: 1313 microversion: 2.1 time: 0.277171 Jun 27 21:18:18.889367 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 168/324] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:18 2022] GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:19.097624 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4536c38a-d514-4549-8192-0146afd0074e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:19.098710 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4536c38a-d514-4549-8192-0146afd0074e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:19.106318 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4536c38a-d514-4549-8192-0146afd0074e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:19.107189 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4536c38a-d514-4549-8192-0146afd0074e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:19.108402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4536c38a-d514-4549-8192-0146afd0074e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:19.109284 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4536c38a-d514-4549-8192-0146afd0074e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:19.249788 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f2f9f066-6598-4c1b-9aad-511d5467f536 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:19.250422 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f2f9f066-6598-4c1b-9aad-511d5467f536 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:19.259874 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f2f9f066-6598-4c1b-9aad-511d5467f536 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:19.260329 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f2f9f066-6598-4c1b-9aad-511d5467f536 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:19.261213 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f2f9f066-6598-4c1b-9aad-511d5467f536 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:19.261797 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f2f9f066-6598-4c1b-9aad-511d5467f536 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:19.532873 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4536c38a-d514-4549-8192-0146afd0074e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:19.551173 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f2f9f066-6598-4c1b-9aad-511d5467f536 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:19.551514 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4536c38a-d514-4549-8192-0146afd0074e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2" status: 200 len: 1367 microversion: 2.1 time: 0.456830 Jun 27 21:18:19.552782 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 157/325] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:19 2022] GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 => generated 1367 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:19.564872 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f2f9f066-6598-4c1b-9aad-511d5467f536 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:19.565128 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-dd9f3230-289d-45fa-bc74-300b9696a353 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:19.566078 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-dd9f3230-289d-45fa-bc74-300b9696a353 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:19.566417 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f2f9f066-6598-4c1b-9aad-511d5467f536 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:19.570176 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f2f9f066-6598-4c1b-9aad-511d5467f536 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1722 microversion: 2.20 time: 0.325347 Jun 27 21:18:19.572723 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 169/326] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:19 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1722 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:18:19.580136 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b7df0ca8-41a2-4737-9517-e96b780c452f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:19.581178 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b7df0ca8-41a2-4737-9517-e96b780c452f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:19.594801 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b7df0ca8-41a2-4737-9517-e96b780c452f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:19.598559 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b7df0ca8-41a2-4737-9517-e96b780c452f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:19.600677 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd9f3230-289d-45fa-bc74-300b9696a353 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:19.601227 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd9f3230-289d-45fa-bc74-300b9696a353 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:19.602146 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd9f3230-289d-45fa-bc74-300b9696a353 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:19.602585 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd9f3230-289d-45fa-bc74-300b9696a353 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:19.602703 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b7df0ca8-41a2-4737-9517-e96b780c452f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:19.603202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b7df0ca8-41a2-4737-9517-e96b780c452f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:19.646942 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=100 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:19.753160 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b7df0ca8-41a2-4737-9517-e96b780c452f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:19.764068 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b7df0ca8-41a2-4737-9517-e96b780c452f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1205 microversion: 2.1 time: 0.189809 Jun 27 21:18:19.765059 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 170/327] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:19 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1205 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:19.779568 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5ad1395a-f7c4-42f0-ab05-0a266742848b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:19.780192 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-5ad1395a-f7c4-42f0-ab05-0a266742848b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:19.792029 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5ad1395a-f7c4-42f0-ab05-0a266742848b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:19.792518 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5ad1395a-f7c4-42f0-ab05-0a266742848b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:19.793412 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5ad1395a-f7c4-42f0-ab05-0a266742848b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:19.794529 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5ad1395a-f7c4-42f0-ab05-0a266742848b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:19.897757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-dd9f3230-289d-45fa-bc74-300b9696a353 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:19.914977 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-dd9f3230-289d-45fa-bc74-300b9696a353 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1371 microversion: 2.1 time: 0.359905 Jun 27 21:18:19.921739 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 158/328] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:19 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1371 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:19.932049 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2f8d4c13-0fef-4f1e-ad3f-730ffef34d9a tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:19.933101 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2f8d4c13-0fef-4f1e-ad3f-730ffef34d9a tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] [instance: c75c0a0d-ba4c-4f60-8cfd-427581097267] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:19.946528 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f8d4c13-0fef-4f1e-ad3f-730ffef34d9a tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:19.947734 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f8d4c13-0fef-4f1e-ad3f-730ffef34d9a tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:19.949730 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f8d4c13-0fef-4f1e-ad3f-730ffef34d9a tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:19.950757 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f8d4c13-0fef-4f1e-ad3f-730ffef34d9a tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:20.060902 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5ad1395a-f7c4-42f0-ab05-0a266742848b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:20.072781 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5ad1395a-f7c4-42f0-ab05-0a266742848b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1724 microversion: 2.1 time: 0.306520 Jun 27 21:18:20.077329 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 171/329] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:19 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:20.263050 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2f8d4c13-0fef-4f1e-ad3f-730ffef34d9a tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ebda0ab7d045ce92da3d5512f30eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e09a9ddb84c7ea356c7df622281da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:20.287621 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2f8d4c13-0fef-4f1e-ad3f-730ffef34d9a tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] 10.222.0.13 "GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267" status: 200 len: 1313 microversion: 2.1 time: 0.363485 Jun 27 21:18:20.288667 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 159/330] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:19 2022] GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267 => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:20.454430 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-3ff1798a-b89a-41e4-a77a-46d30b884794 req-a9f09c95-2952-4a8e-b9ff-98524948ecf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c5b1522-b5e3-4328-9292-5f99591179a2", "tag": "63757cf8-adc3-4cb5-8c67-986e0c574946"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:20.465273 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-3ff1798a-b89a-41e4-a77a-46d30b884794 req-a9f09c95-2952-4a8e-b9ff-98524948ecf6 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:20.466060 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-3ff1798a-b89a-41e4-a77a-46d30b884794 req-a9f09c95-2952-4a8e-b9ff-98524948ecf6 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:20.479800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-3ff1798a-b89a-41e4-a77a-46d30b884794 req-a9f09c95-2952-4a8e-b9ff-98524948ecf6 service nova] Creating event network-changed:63757cf8-adc3-4cb5-8c67-986e0c574946 for instance 3c5b1522-b5e3-4328-9292-5f99591179a2 on hv-cinder-84773 Jun 27 21:18:20.485946 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-3ff1798a-b89a-41e4-a77a-46d30b884794 req-a9f09c95-2952-4a8e-b9ff-98524948ecf6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034923 Jun 27 21:18:20.487807 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 172/331] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:18:20.574559 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bb0d382d-133d-4018-b7db-11f4e6400886 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:20.575261 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bb0d382d-133d-4018-b7db-11f4e6400886 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:20.582930 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bb0d382d-133d-4018-b7db-11f4e6400886 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:20.583436 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bb0d382d-133d-4018-b7db-11f4e6400886 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:20.584407 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bb0d382d-133d-4018-b7db-11f4e6400886 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:20.585352 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bb0d382d-133d-4018-b7db-11f4e6400886 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:20.594488 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2d8e8cac-c917-4acc-9771-7081f17cf6b2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:20.595377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2d8e8cac-c917-4acc-9771-7081f17cf6b2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:20.606024 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2d8e8cac-c917-4acc-9771-7081f17cf6b2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:20.606517 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2d8e8cac-c917-4acc-9771-7081f17cf6b2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:20.607879 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2d8e8cac-c917-4acc-9771-7081f17cf6b2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:20.608573 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2d8e8cac-c917-4acc-9771-7081f17cf6b2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:20.889084 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bb0d382d-133d-4018-b7db-11f4e6400886 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:20.900642 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bb0d382d-133d-4018-b7db-11f4e6400886 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2" status: 200 len: 1367 microversion: 2.1 time: 0.334259 Jun 27 21:18:20.902091 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 160/332] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:20 2022] GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 => generated 1367 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:20.902963 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2d8e8cac-c917-4acc-9771-7081f17cf6b2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:20.907616 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0c973d4d-65de-4f41-bb63-29aebb65160e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:20.908575 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0c973d4d-65de-4f41-bb63-29aebb65160e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:20.915689 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2d8e8cac-c917-4acc-9771-7081f17cf6b2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:20.916797 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0c973d4d-65de-4f41-bb63-29aebb65160e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:20.917277 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0c973d4d-65de-4f41-bb63-29aebb65160e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:20.918276 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0c973d4d-65de-4f41-bb63-29aebb65160e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:20.919012 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2d8e8cac-c917-4acc-9771-7081f17cf6b2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:20.919178 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0c973d4d-65de-4f41-bb63-29aebb65160e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:20.922124 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2d8e8cac-c917-4acc-9771-7081f17cf6b2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1722 microversion: 2.20 time: 0.333793 Jun 27 21:18:20.928361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 173/333] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:20 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1722 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:20.940271 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6ed40091-d05d-4739-aad1-2f2d57914147 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:20.941199 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6ed40091-d05d-4739-aad1-2f2d57914147 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:20.949072 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6ed40091-d05d-4739-aad1-2f2d57914147 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:20.949817 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6ed40091-d05d-4739-aad1-2f2d57914147 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:20.951434 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6ed40091-d05d-4739-aad1-2f2d57914147 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:20.952046 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6ed40091-d05d-4739-aad1-2f2d57914147 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:21.282514 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0c973d4d-65de-4f41-bb63-29aebb65160e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:21.292196 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0c973d4d-65de-4f41-bb63-29aebb65160e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1260 microversion: 2.1 time: 0.388708 Jun 27 21:18:21.292801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 161/334] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:20 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1260 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:21.298431 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-946d0451-0d28-4bab-aaf5-a188aa6aaeb4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:21.299333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-946d0451-0d28-4bab-aaf5-a188aa6aaeb4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:21.307780 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-946d0451-0d28-4bab-aaf5-a188aa6aaeb4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:21.308355 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-946d0451-0d28-4bab-aaf5-a188aa6aaeb4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:21.309254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-946d0451-0d28-4bab-aaf5-a188aa6aaeb4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:21.309714 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-946d0451-0d28-4bab-aaf5-a188aa6aaeb4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:21.314872 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:21.511151 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-6ed40091-d05d-4739-aad1-2f2d57914147 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:21.529392 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6ed40091-d05d-4739-aad1-2f2d57914147 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1565 microversion: 2.1 time: 0.598255 Jun 27 21:18:21.532399 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 174/335] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:20 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1565 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:21.543344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-946d0451-0d28-4bab-aaf5-a188aa6aaeb4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:21.556348 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f118a9d4-1bb5-4b06-b32e-7be2b686cf62 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:21.557158 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f118a9d4-1bb5-4b06-b32e-7be2b686cf62 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] [instance: c75c0a0d-ba4c-4f60-8cfd-427581097267] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:21.560833 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-946d0451-0d28-4bab-aaf5-a188aa6aaeb4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1701 microversion: 2.1 time: 0.266515 Jun 27 21:18:21.580645 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 162/336] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:21 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1701 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:21.596335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f4c78367-0f1f-47f8-9cb7-ae286ae4711e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:21.597042 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f4c78367-0f1f-47f8-9cb7-ae286ae4711e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:21.599421 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f118a9d4-1bb5-4b06-b32e-7be2b686cf62 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:21.600077 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f118a9d4-1bb5-4b06-b32e-7be2b686cf62 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:21.602510 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f118a9d4-1bb5-4b06-b32e-7be2b686cf62 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:21.605970 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f118a9d4-1bb5-4b06-b32e-7be2b686cf62 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:21.619466 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f4c78367-0f1f-47f8-9cb7-ae286ae4711e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:21.620226 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f4c78367-0f1f-47f8-9cb7-ae286ae4711e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:21.622121 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f4c78367-0f1f-47f8-9cb7-ae286ae4711e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:21.622571 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f4c78367-0f1f-47f8-9cb7-ae286ae4711e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:21.802817 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f4c78367-0f1f-47f8-9cb7-ae286ae4711e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.216339 Jun 27 21:18:21.806039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 163/337] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 27 21:18:21 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d/os-interface => generated 284 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:18:21.819063 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c6866e6e-3444-4470-a300-47f5d671d293 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:21.844508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c6866e6e-3444-4470-a300-47f5d671d293 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:21.845338 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c6866e6e-3444-4470-a300-47f5d671d293 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:21.969744 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c6866e6e-3444-4470-a300-47f5d671d293 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Going to try to start instance {{(pid=117889) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 27 21:18:22.048640 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c6866e6e-3444-4470-a300-47f5d671d293 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "POST /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1/action" status: 202 len: 0 microversion: 2.1 time: 0.234452 Jun 27 21:18:22.048640 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 164/338] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 27 21:18:21 2022] POST /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:18:22.059633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-26ac1bd8-7b07-47d0-bdb4-40927f8f728d req-129c8445-6c49-4465-b9dd-71071f1186eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c75c0a0d-ba4c-4f60-8cfd-427581097267", "name": "network-vif-plugged", "status": "completed", "tag": "e8262eaa-95f7-4e78-8938-ee6bbcfd541b"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:22.082571 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f118a9d4-1bb5-4b06-b32e-7be2b686cf62 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ebda0ab7d045ce92da3d5512f30eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e09a9ddb84c7ea356c7df622281da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:22.087983 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-26ac1bd8-7b07-47d0-bdb4-40927f8f728d req-129c8445-6c49-4465-b9dd-71071f1186eb service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:22.088815 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-26ac1bd8-7b07-47d0-bdb4-40927f8f728d req-129c8445-6c49-4465-b9dd-71071f1186eb service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:22.099841 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f118a9d4-1bb5-4b06-b32e-7be2b686cf62 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] 10.222.0.13 "GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267" status: 200 len: 1313 microversion: 2.1 time: 0.565360 Jun 27 21:18:22.100430 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 175/339] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:21 2022] GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267 => generated 1313 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:22.104464 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-26ac1bd8-7b07-47d0-bdb4-40927f8f728d req-129c8445-6c49-4465-b9dd-71071f1186eb service nova] Creating event network-vif-plugged:e8262eaa-95f7-4e78-8938-ee6bbcfd541b for instance c75c0a0d-ba4c-4f60-8cfd-427581097267 on hv-cinder-84773 Jun 27 21:18:22.116293 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-50c54230-4495-4d8a-8a54-75c178f9a5a7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:22.117898 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-50c54230-4495-4d8a-8a54-75c178f9a5a7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:22.127355 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-26ac1bd8-7b07-47d0-bdb4-40927f8f728d req-129c8445-6c49-4465-b9dd-71071f1186eb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073826 Jun 27 21:18:22.128410 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 165/340] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:18:22.139995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3205484e-92f4-420c-a1a0-e188a675df01 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:22.140820 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3205484e-92f4-420c-a1a0-e188a675df01 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:22.145689 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-50c54230-4495-4d8a-8a54-75c178f9a5a7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:22.147465 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-50c54230-4495-4d8a-8a54-75c178f9a5a7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:22.149898 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-50c54230-4495-4d8a-8a54-75c178f9a5a7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:22.152224 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-50c54230-4495-4d8a-8a54-75c178f9a5a7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:22.153193 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3205484e-92f4-420c-a1a0-e188a675df01 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:22.153683 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3205484e-92f4-420c-a1a0-e188a675df01 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:22.157557 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3205484e-92f4-420c-a1a0-e188a675df01 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:22.158005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3205484e-92f4-420c-a1a0-e188a675df01 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:22.492260 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-50c54230-4495-4d8a-8a54-75c178f9a5a7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:22.503287 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-50c54230-4495-4d8a-8a54-75c178f9a5a7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2" status: 200 len: 1367 microversion: 2.1 time: 0.392827 Jun 27 21:18:22.503871 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 176/341] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:22 2022] GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 => generated 1367 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:22.509771 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-17a69bf6-eade-4383-8792-63cd6f183370 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:22.510358 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-17a69bf6-eade-4383-8792-63cd6f183370 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:22.518387 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-17a69bf6-eade-4383-8792-63cd6f183370 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:22.519383 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-17a69bf6-eade-4383-8792-63cd6f183370 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:22.519578 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-17a69bf6-eade-4383-8792-63cd6f183370 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:22.520171 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-17a69bf6-eade-4383-8792-63cd6f183370 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:22.679135 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-17a69bf6-eade-4383-8792-63cd6f183370 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:22.693009 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-17a69bf6-eade-4383-8792-63cd6f183370 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1710 microversion: 2.1 time: 0.187455 Jun 27 21:18:22.694619 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 177/342] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:22 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1710 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:22.712356 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3205484e-92f4-420c-a1a0-e188a675df01 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:22.714530 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-1b590f3b-0acf-4478-8668-5e16fdb62c4b req-7c489063-dfd2-427a-a651-fb9f3a9db655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9323a6ac-3a15-471a-b676-eb3e809a8637", "tag": "36112ae1-bee5-4df6-9469-82c6af7bb1f4"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:22.722444 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3205484e-92f4-420c-a1a0-e188a675df01 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:22.723348 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-1b590f3b-0acf-4478-8668-5e16fdb62c4b req-7c489063-dfd2-427a-a651-fb9f3a9db655 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:22.723910 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-1b590f3b-0acf-4478-8668-5e16fdb62c4b req-7c489063-dfd2-427a-a651-fb9f3a9db655 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:22.724083 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3205484e-92f4-420c-a1a0-e188a675df01 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:22.725499 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3205484e-92f4-420c-a1a0-e188a675df01 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1722 microversion: 2.20 time: 0.595820 Jun 27 21:18:22.726110 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 166/343] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:22 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1722 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:22.732845 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2295adbb-11c2-4bdb-ae85-c97f59ef8810 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:22.733808 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2295adbb-11c2-4bdb-ae85-c97f59ef8810 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:22.741010 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2295adbb-11c2-4bdb-ae85-c97f59ef8810 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:22.741806 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2295adbb-11c2-4bdb-ae85-c97f59ef8810 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:22.741921 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-1b590f3b-0acf-4478-8668-5e16fdb62c4b req-7c489063-dfd2-427a-a651-fb9f3a9db655 service nova] Creating event network-changed:36112ae1-bee5-4df6-9469-82c6af7bb1f4 for instance 9323a6ac-3a15-471a-b676-eb3e809a8637 on hv-cinder-84773 Jun 27 21:18:22.742977 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2295adbb-11c2-4bdb-ae85-c97f59ef8810 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:22.743661 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2295adbb-11c2-4bdb-ae85-c97f59ef8810 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:22.750308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-1b590f3b-0acf-4478-8668-5e16fdb62c4b req-7c489063-dfd2-427a-a651-fb9f3a9db655 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041119 Jun 27 21:18:22.751298 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 178/344] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:18:22.990841 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2295adbb-11c2-4bdb-ae85-c97f59ef8810 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:22.999481 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2295adbb-11c2-4bdb-ae85-c97f59ef8810 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1260 microversion: 2.1 time: 0.271647 Jun 27 21:18:23.000105 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 167/345] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:22 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1260 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:23.119754 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ee78c660-c936-4ba3-b85e-5d0eccc50e27 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:23.120591 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ee78c660-c936-4ba3-b85e-5d0eccc50e27 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] [instance: c75c0a0d-ba4c-4f60-8cfd-427581097267] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:23.128338 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee78c660-c936-4ba3-b85e-5d0eccc50e27 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:23.128894 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee78c660-c936-4ba3-b85e-5d0eccc50e27 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:23.129721 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee78c660-c936-4ba3-b85e-5d0eccc50e27 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:23.130154 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee78c660-c936-4ba3-b85e-5d0eccc50e27 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:23.301244 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ee78c660-c936-4ba3-b85e-5d0eccc50e27 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ebda0ab7d045ce92da3d5512f30eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e09a9ddb84c7ea356c7df622281da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:23.309923 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ee78c660-c936-4ba3-b85e-5d0eccc50e27 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] 10.222.0.13 "GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267" status: 200 len: 1313 microversion: 2.1 time: 0.196419 Jun 27 21:18:23.310472 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 179/346] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:23 2022] GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:23.522141 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bea48497-52bb-4867-8cd0-5e13dcbdc9fa tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:23.522806 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bea48497-52bb-4867-8cd0-5e13dcbdc9fa tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:23.530681 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bea48497-52bb-4867-8cd0-5e13dcbdc9fa tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:23.531126 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bea48497-52bb-4867-8cd0-5e13dcbdc9fa tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:23.531914 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bea48497-52bb-4867-8cd0-5e13dcbdc9fa tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:23.532389 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bea48497-52bb-4867-8cd0-5e13dcbdc9fa tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:23.719635 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b86e9164-cd37-4722-975b-6c34c79c8d53 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:23.721075 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b86e9164-cd37-4722-975b-6c34c79c8d53 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:23.729321 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b86e9164-cd37-4722-975b-6c34c79c8d53 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:23.730314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b86e9164-cd37-4722-975b-6c34c79c8d53 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:23.730843 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b86e9164-cd37-4722-975b-6c34c79c8d53 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:23.731519 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b86e9164-cd37-4722-975b-6c34c79c8d53 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:23.922063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b86e9164-cd37-4722-975b-6c34c79c8d53 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:23.931019 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b86e9164-cd37-4722-975b-6c34c79c8d53 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1710 microversion: 2.1 time: 0.218518 Jun 27 21:18:23.931824 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 180/347] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:23 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1710 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:23.946800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-84663cae-7410-4b53-a7ee-94e51547db04 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:23.947409 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-84663cae-7410-4b53-a7ee-94e51547db04 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:23.954022 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-84663cae-7410-4b53-a7ee-94e51547db04 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:23.954264 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bea48497-52bb-4867-8cd0-5e13dcbdc9fa tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:23.954717 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-84663cae-7410-4b53-a7ee-94e51547db04 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:23.955310 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-84663cae-7410-4b53-a7ee-94e51547db04 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:23.955666 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-84663cae-7410-4b53-a7ee-94e51547db04 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:23.970300 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bea48497-52bb-4867-8cd0-5e13dcbdc9fa tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2" status: 200 len: 1367 microversion: 2.1 time: 0.451816 Jun 27 21:18:23.971481 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 168/348] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:23 2022] GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 => generated 1367 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:24.023407 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a928d1be-be3a-4210-b6bf-8af03ab96484 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:24.024037 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a928d1be-be3a-4210-b6bf-8af03ab96484 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:24.030786 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a928d1be-be3a-4210-b6bf-8af03ab96484 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:24.031199 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a928d1be-be3a-4210-b6bf-8af03ab96484 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:24.032279 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a928d1be-be3a-4210-b6bf-8af03ab96484 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:24.032689 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a928d1be-be3a-4210-b6bf-8af03ab96484 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:24.123372 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-84663cae-7410-4b53-a7ee-94e51547db04 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:24.134305 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-84663cae-7410-4b53-a7ee-94e51547db04 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:24.136456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-84663cae-7410-4b53-a7ee-94e51547db04 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:24.138396 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-84663cae-7410-4b53-a7ee-94e51547db04 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1722 microversion: 2.20 time: 0.195899 Jun 27 21:18:24.139016 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 181/349] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:23 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:24.214861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a928d1be-be3a-4210-b6bf-8af03ab96484 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:24.229738 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a928d1be-be3a-4210-b6bf-8af03ab96484 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1260 microversion: 2.1 time: 0.210861 Jun 27 21:18:24.230727 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 169/350] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:24 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:18:24.329553 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b32897af-db43-4bc8-8c25-43f797114938 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:24.330385 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b32897af-db43-4bc8-8c25-43f797114938 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] [instance: c75c0a0d-ba4c-4f60-8cfd-427581097267] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:24.341736 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b32897af-db43-4bc8-8c25-43f797114938 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:24.342254 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b32897af-db43-4bc8-8c25-43f797114938 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:24.343283 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b32897af-db43-4bc8-8c25-43f797114938 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:24.343800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b32897af-db43-4bc8-8c25-43f797114938 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:24.505414 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b32897af-db43-4bc8-8c25-43f797114938 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ebda0ab7d045ce92da3d5512f30eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e09a9ddb84c7ea356c7df622281da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:24.515233 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b32897af-db43-4bc8-8c25-43f797114938 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] 10.222.0.13 "GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267" status: 200 len: 1313 microversion: 2.1 time: 0.191646 Jun 27 21:18:24.516123 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 182/351] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:24 2022] GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:18:24.955474 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6bd7c0eb-d11f-480e-b085-42136a752d5d tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:24.956366 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6bd7c0eb-d11f-480e-b085-42136a752d5d tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:24.965152 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6bd7c0eb-d11f-480e-b085-42136a752d5d tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:24.965702 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6bd7c0eb-d11f-480e-b085-42136a752d5d tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:24.967268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6bd7c0eb-d11f-480e-b085-42136a752d5d tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:24.967688 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6bd7c0eb-d11f-480e-b085-42136a752d5d tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:24.994040 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f3500d83-621b-41e5-a093-32b9b5bec330 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:24.994706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f3500d83-621b-41e5-a093-32b9b5bec330 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:25.003364 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f3500d83-621b-41e5-a093-32b9b5bec330 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:25.003864 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f3500d83-621b-41e5-a093-32b9b5bec330 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:25.004685 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f3500d83-621b-41e5-a093-32b9b5bec330 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:25.005340 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f3500d83-621b-41e5-a093-32b9b5bec330 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:25.191155 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f3500d83-621b-41e5-a093-32b9b5bec330 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:25.207307 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f3500d83-621b-41e5-a093-32b9b5bec330 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2" status: 200 len: 1367 microversion: 2.1 time: 0.219495 Jun 27 21:18:25.208365 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 183/352] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:24 2022] GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:18:25.218201 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-dadfb3d7-8804-4e51-888a-11a03e40816d req-a480ca8d-3fa9-46d8-ab49-8e21751c5795 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a1409c2-ecfa-4ed4-b547-aa5667367e5d", "tag": "b9348a43-0456-47cf-97ba-a8ab01ba6107"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:25.233770 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-dadfb3d7-8804-4e51-888a-11a03e40816d req-a480ca8d-3fa9-46d8-ab49-8e21751c5795 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:25.234303 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-dadfb3d7-8804-4e51-888a-11a03e40816d req-a480ca8d-3fa9-46d8-ab49-8e21751c5795 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:25.244911 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6bd7c0eb-d11f-480e-b085-42136a752d5d tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:25.253192 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-dadfb3d7-8804-4e51-888a-11a03e40816d req-a480ca8d-3fa9-46d8-ab49-8e21751c5795 service nova] Creating event network-changed:b9348a43-0456-47cf-97ba-a8ab01ba6107 for instance 3a1409c2-ecfa-4ed4-b547-aa5667367e5d on hv-cinder-84773 Jun 27 21:18:25.255204 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6bd7c0eb-d11f-480e-b085-42136a752d5d tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1710 microversion: 2.1 time: 0.303590 Jun 27 21:18:25.255314 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 170/353] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:24 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1710 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:25.261026 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f8acf5b3-54ac-4932-892e-cf139388b653 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:25.261267 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-dadfb3d7-8804-4e51-888a-11a03e40816d req-a480ca8d-3fa9-46d8-ab49-8e21751c5795 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050923 Jun 27 21:18:25.261951 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 184/354] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:18:25.262129 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f8acf5b3-54ac-4932-892e-cf139388b653 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:25.268235 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7323cf12-bd1c-47a0-b02c-ee7b0e87db7e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:25.269264 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7323cf12-bd1c-47a0-b02c-ee7b0e87db7e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:25.271045 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f8acf5b3-54ac-4932-892e-cf139388b653 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:25.271586 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f8acf5b3-54ac-4932-892e-cf139388b653 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:25.272491 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f8acf5b3-54ac-4932-892e-cf139388b653 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:25.272977 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f8acf5b3-54ac-4932-892e-cf139388b653 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:25.273137 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=6 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:25.279475 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7323cf12-bd1c-47a0-b02c-ee7b0e87db7e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:25.280048 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7323cf12-bd1c-47a0-b02c-ee7b0e87db7e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:25.280863 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7323cf12-bd1c-47a0-b02c-ee7b0e87db7e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:25.281390 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7323cf12-bd1c-47a0-b02c-ee7b0e87db7e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:25.438022 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f8acf5b3-54ac-4932-892e-cf139388b653 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:25.441661 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7323cf12-bd1c-47a0-b02c-ee7b0e87db7e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:25.449569 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f8acf5b3-54ac-4932-892e-cf139388b653 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:25.449943 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7323cf12-bd1c-47a0-b02c-ee7b0e87db7e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1260 microversion: 2.1 time: 0.186760 Jun 27 21:18:25.450543 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 185/355] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:25 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:25.452699 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f8acf5b3-54ac-4932-892e-cf139388b653 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:25.454888 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f8acf5b3-54ac-4932-892e-cf139388b653 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1722 microversion: 2.20 time: 0.198159 Jun 27 21:18:25.455995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 171/356] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:25 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:25.534837 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9f7f31c6-2f14-469e-abd7-bea4a01eac0b tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:25.535484 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9f7f31c6-2f14-469e-abd7-bea4a01eac0b tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] [instance: c75c0a0d-ba4c-4f60-8cfd-427581097267] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:25.542933 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9f7f31c6-2f14-469e-abd7-bea4a01eac0b tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:25.543389 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9f7f31c6-2f14-469e-abd7-bea4a01eac0b tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:25.544169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9f7f31c6-2f14-469e-abd7-bea4a01eac0b tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:25.544598 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9f7f31c6-2f14-469e-abd7-bea4a01eac0b tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:25.720750 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9f7f31c6-2f14-469e-abd7-bea4a01eac0b tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ebda0ab7d045ce92da3d5512f30eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e09a9ddb84c7ea356c7df622281da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:25.735230 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9f7f31c6-2f14-469e-abd7-bea4a01eac0b tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] 10.222.0.13 "GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267" status: 200 len: 1463 microversion: 2.1 time: 0.204162 Jun 27 21:18:25.736132 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 186/357] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:25 2022] GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267 => generated 1463 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:25.783614 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6a0caf28-4b43-44fb-beff-7b1ee77d8c14 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:25.784177 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6a0caf28-4b43-44fb-beff-7b1ee77d8c14 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] [instance: c75c0a0d-ba4c-4f60-8cfd-427581097267] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:25.793959 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6a0caf28-4b43-44fb-beff-7b1ee77d8c14 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:25.794476 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6a0caf28-4b43-44fb-beff-7b1ee77d8c14 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:25.795504 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6a0caf28-4b43-44fb-beff-7b1ee77d8c14 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:25.796003 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6a0caf28-4b43-44fb-beff-7b1ee77d8c14 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:25.831284 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6a0caf28-4b43-44fb-beff-7b1ee77d8c14 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] [instance: c75c0a0d-ba4c-4f60-8cfd-427581097267] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:18:25.849146 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:25.885824 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=16 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:25.923549 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6a0caf28-4b43-44fb-beff-7b1ee77d8c14 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267" status: 204 len: 0 microversion: 2.1 time: 0.145895 Jun 27 21:18:25.924468 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 172/358] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:18:25 2022] DELETE /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:18:25.933408 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-612f85b6-49c9-4904-9d54-801955818426 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:25.934051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-612f85b6-49c9-4904-9d54-801955818426 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] [instance: c75c0a0d-ba4c-4f60-8cfd-427581097267] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:25.940643 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-612f85b6-49c9-4904-9d54-801955818426 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:25.941276 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-612f85b6-49c9-4904-9d54-801955818426 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:25.942059 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-612f85b6-49c9-4904-9d54-801955818426 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:25.942503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-612f85b6-49c9-4904-9d54-801955818426 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:26.179899 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-612f85b6-49c9-4904-9d54-801955818426 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ebda0ab7d045ce92da3d5512f30eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e09a9ddb84c7ea356c7df622281da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:26.188322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-612f85b6-49c9-4904-9d54-801955818426 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] 10.222.0.13 "GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267" status: 200 len: 1469 microversion: 2.1 time: 0.259161 Jun 27 21:18:26.188971 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 187/359] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:25 2022] GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267 => generated 1469 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:26.227735 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9b4ff0a3-11bf-424f-adfc-3875932546d7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:26.229497 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9b4ff0a3-11bf-424f-adfc-3875932546d7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:26.237418 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9b4ff0a3-11bf-424f-adfc-3875932546d7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:26.238363 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9b4ff0a3-11bf-424f-adfc-3875932546d7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:26.239259 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9b4ff0a3-11bf-424f-adfc-3875932546d7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:26.239801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9b4ff0a3-11bf-424f-adfc-3875932546d7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:26.279906 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f1e61996-5bbc-4933-a988-cef08eb28e30 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:26.280957 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f1e61996-5bbc-4933-a988-cef08eb28e30 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:26.286789 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=24 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:26.294061 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f1e61996-5bbc-4933-a988-cef08eb28e30 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:26.295202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f1e61996-5bbc-4933-a988-cef08eb28e30 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:26.297027 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f1e61996-5bbc-4933-a988-cef08eb28e30 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:26.297619 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f1e61996-5bbc-4933-a988-cef08eb28e30 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:26.411469 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9b4ff0a3-11bf-424f-adfc-3875932546d7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:26.427556 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9b4ff0a3-11bf-424f-adfc-3875932546d7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2" status: 200 len: 1367 microversion: 2.1 time: 0.204513 Jun 27 21:18:26.428336 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 173/360] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:26 2022] GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:26.462738 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f1e61996-5bbc-4933-a988-cef08eb28e30 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:26.471806 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d5b914c6-0884-4a54-a11e-cd7c2923dcee tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:26.472749 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d5b914c6-0884-4a54-a11e-cd7c2923dcee tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:26.480126 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d5b914c6-0884-4a54-a11e-cd7c2923dcee tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:26.480586 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d5b914c6-0884-4a54-a11e-cd7c2923dcee tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:26.481467 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d5b914c6-0884-4a54-a11e-cd7c2923dcee tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:26.482115 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d5b914c6-0884-4a54-a11e-cd7c2923dcee tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:26.486207 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f1e61996-5bbc-4933-a988-cef08eb28e30 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1710 microversion: 2.1 time: 0.216372 Jun 27 21:18:26.487229 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 188/361] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:26 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1710 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:26.496008 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e51302a7-3671-431f-8b61-e2a2b2a79c09 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:26.497111 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e51302a7-3671-431f-8b61-e2a2b2a79c09 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:26.507737 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e51302a7-3671-431f-8b61-e2a2b2a79c09 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:26.508296 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e51302a7-3671-431f-8b61-e2a2b2a79c09 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:26.509054 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e51302a7-3671-431f-8b61-e2a2b2a79c09 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:26.509480 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e51302a7-3671-431f-8b61-e2a2b2a79c09 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:26.512440 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=100 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:26.641630 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d5b914c6-0884-4a54-a11e-cd7c2923dcee tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:26.649264 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d5b914c6-0884-4a54-a11e-cd7c2923dcee tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1260 microversion: 2.1 time: 0.185243 Jun 27 21:18:26.649929 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 174/362] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:26 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:26.673209 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e51302a7-3671-431f-8b61-e2a2b2a79c09 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:26.681861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e51302a7-3671-431f-8b61-e2a2b2a79c09 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:26.683367 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e51302a7-3671-431f-8b61-e2a2b2a79c09 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:26.684705 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e51302a7-3671-431f-8b61-e2a2b2a79c09 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1743 microversion: 2.20 time: 0.196043 Jun 27 21:18:26.685334 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 189/363] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:26 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1743 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:27.208146 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b8893301-6eb4-4e09-8779-85a5fc63d14c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:27.208764 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b8893301-6eb4-4e09-8779-85a5fc63d14c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] [instance: c75c0a0d-ba4c-4f60-8cfd-427581097267] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:27.216284 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b8893301-6eb4-4e09-8779-85a5fc63d14c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:27.216727 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b8893301-6eb4-4e09-8779-85a5fc63d14c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:27.217574 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b8893301-6eb4-4e09-8779-85a5fc63d14c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:27.218013 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b8893301-6eb4-4e09-8779-85a5fc63d14c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:27.379358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b8893301-6eb4-4e09-8779-85a5fc63d14c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ebda0ab7d045ce92da3d5512f30eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e09a9ddb84c7ea356c7df622281da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:27.392536 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b8893301-6eb4-4e09-8779-85a5fc63d14c tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] 10.222.0.13 "GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267" status: 200 len: 1469 microversion: 2.1 time: 0.188085 Jun 27 21:18:27.393643 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 175/364] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:27 2022] GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267 => generated 1469 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:27.451110 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3c42c24b-b5fb-43ac-8735-7957be0de662 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:27.451772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3c42c24b-b5fb-43ac-8735-7957be0de662 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:27.458812 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3c42c24b-b5fb-43ac-8735-7957be0de662 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:27.459148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3c42c24b-b5fb-43ac-8735-7957be0de662 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:27.459913 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3c42c24b-b5fb-43ac-8735-7957be0de662 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:27.460340 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3c42c24b-b5fb-43ac-8735-7957be0de662 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:27.505407 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-91cb424a-e0e2-4393-9127-bab92bdcdbe8 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:27.506259 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-91cb424a-e0e2-4393-9127-bab92bdcdbe8 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:27.513535 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-91cb424a-e0e2-4393-9127-bab92bdcdbe8 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:27.513977 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-91cb424a-e0e2-4393-9127-bab92bdcdbe8 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:27.514954 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-91cb424a-e0e2-4393-9127-bab92bdcdbe8 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:27.515538 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-91cb424a-e0e2-4393-9127-bab92bdcdbe8 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:27.618538 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3c42c24b-b5fb-43ac-8735-7957be0de662 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:27.633020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3c42c24b-b5fb-43ac-8735-7957be0de662 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2" status: 200 len: 1367 microversion: 2.1 time: 0.185352 Jun 27 21:18:27.634627 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 190/365] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:27 2022] GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:27.670365 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c45aaeff-8cb5-4367-a6ab-6a68d9afd956 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:27.671657 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c45aaeff-8cb5-4367-a6ab-6a68d9afd956 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:27.682441 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c45aaeff-8cb5-4367-a6ab-6a68d9afd956 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:27.683344 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c45aaeff-8cb5-4367-a6ab-6a68d9afd956 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:27.684407 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c45aaeff-8cb5-4367-a6ab-6a68d9afd956 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:27.685403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c45aaeff-8cb5-4367-a6ab-6a68d9afd956 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:27.817000 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-91cb424a-e0e2-4393-9127-bab92bdcdbe8 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:27.829424 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-91cb424a-e0e2-4393-9127-bab92bdcdbe8 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1710 microversion: 2.1 time: 0.327988 Jun 27 21:18:27.841290 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 176/366] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:27 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1710 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:27.847262 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0a477e92-2e4d-499b-90ea-18532ca47c60 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:27.848160 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0a477e92-2e4d-499b-90ea-18532ca47c60 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:27.854836 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0a477e92-2e4d-499b-90ea-18532ca47c60 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:27.855282 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0a477e92-2e4d-499b-90ea-18532ca47c60 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:27.856065 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0a477e92-2e4d-499b-90ea-18532ca47c60 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:27.856499 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0a477e92-2e4d-499b-90ea-18532ca47c60 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:27.861191 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:27.868793 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c45aaeff-8cb5-4367-a6ab-6a68d9afd956 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:27.880193 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c45aaeff-8cb5-4367-a6ab-6a68d9afd956 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1260 microversion: 2.1 time: 0.216473 Jun 27 21:18:27.881690 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 191/367] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:27 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:27.897904 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-b62bfab4-b86e-47c1-ac3b-826be6318cda req-af33932a-b977-4991-9d52-08961ca755f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c5b1522-b5e3-4328-9292-5f99591179a2", "name": "network-vif-plugged", "status": "completed", "tag": "63757cf8-adc3-4cb5-8c67-986e0c574946"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:27.908101 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:27.919889 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-b62bfab4-b86e-47c1-ac3b-826be6318cda req-af33932a-b977-4991-9d52-08961ca755f0 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:27.919889 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-b62bfab4-b86e-47c1-ac3b-826be6318cda req-af33932a-b977-4991-9d52-08961ca755f0 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:27.935449 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-b62bfab4-b86e-47c1-ac3b-826be6318cda req-af33932a-b977-4991-9d52-08961ca755f0 service nova] Creating event network-vif-plugged:63757cf8-adc3-4cb5-8c67-986e0c574946 for instance 3c5b1522-b5e3-4328-9292-5f99591179a2 on hv-cinder-84773 Jun 27 21:18:27.941310 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-b62bfab4-b86e-47c1-ac3b-826be6318cda req-af33932a-b977-4991-9d52-08961ca755f0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048286 Jun 27 21:18:27.942278 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 192/368] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:18:28.197532 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0a477e92-2e4d-499b-90ea-18532ca47c60 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:28.208255 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0a477e92-2e4d-499b-90ea-18532ca47c60 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:28.209909 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0a477e92-2e4d-499b-90ea-18532ca47c60 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:28.211772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0a477e92-2e4d-499b-90ea-18532ca47c60 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1743 microversion: 2.20 time: 0.368582 Jun 27 21:18:28.212348 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 177/369] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:27 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1743 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:28.410516 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-35e0ff13-fd56-440d-a0f4-ef9372f4e433 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:28.411259 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-35e0ff13-fd56-440d-a0f4-ef9372f4e433 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] [instance: c75c0a0d-ba4c-4f60-8cfd-427581097267] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:28.419168 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-35e0ff13-fd56-440d-a0f4-ef9372f4e433 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:28.419668 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-35e0ff13-fd56-440d-a0f4-ef9372f4e433 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:28.420535 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-35e0ff13-fd56-440d-a0f4-ef9372f4e433 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:28.421065 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-35e0ff13-fd56-440d-a0f4-ef9372f4e433 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:28.652117 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cd331c41-06dd-4ca0-ace7-d4de86dc6c50 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:28.653000 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cd331c41-06dd-4ca0-ace7-d4de86dc6c50 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:28.659745 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cd331c41-06dd-4ca0-ace7-d4de86dc6c50 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:28.660168 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cd331c41-06dd-4ca0-ace7-d4de86dc6c50 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:28.661337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cd331c41-06dd-4ca0-ace7-d4de86dc6c50 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:28.661777 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cd331c41-06dd-4ca0-ace7-d4de86dc6c50 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:28.667810 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-35e0ff13-fd56-440d-a0f4-ef9372f4e433 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ebda0ab7d045ce92da3d5512f30eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e09a9ddb84c7ea356c7df622281da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:28.676423 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-35e0ff13-fd56-440d-a0f4-ef9372f4e433 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] 10.222.0.13 "GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267" status: 200 len: 1469 microversion: 2.1 time: 0.270474 Jun 27 21:18:28.677196 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 193/370] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:28 2022] GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267 => generated 1469 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:28.853900 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ad8db513-6641-4c84-a9cc-79ed2f463fe0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:28.854927 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ad8db513-6641-4c84-a9cc-79ed2f463fe0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:28.861991 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ad8db513-6641-4c84-a9cc-79ed2f463fe0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:28.862440 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ad8db513-6641-4c84-a9cc-79ed2f463fe0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:28.863745 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ad8db513-6641-4c84-a9cc-79ed2f463fe0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:28.864956 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ad8db513-6641-4c84-a9cc-79ed2f463fe0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:29.049406 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ad8db513-6641-4c84-a9cc-79ed2f463fe0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:29.051617 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cd331c41-06dd-4ca0-ace7-d4de86dc6c50 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:29.058848 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ad8db513-6641-4c84-a9cc-79ed2f463fe0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1710 microversion: 2.1 time: 0.213905 Jun 27 21:18:29.059568 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 194/371] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:28 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1710 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:18:29.059836 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cd331c41-06dd-4ca0-ace7-d4de86dc6c50 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2" status: 200 len: 1367 microversion: 2.1 time: 0.411804 Jun 27 21:18:29.060601 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 178/372] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:28 2022] GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 => generated 1367 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:18:29.068861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-643e878c-c64e-474d-bf60-dec3d53a8c56 req-2dc60fa2-9573-4109-a0a9-9c1950d22cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c75c0a0d-ba4c-4f60-8cfd-427581097267", "name": "network-vif-deleted", "tag": "e8262eaa-95f7-4e78-8938-ee6bbcfd541b"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:29.073968 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-29ad912b-2d33-46c2-8d35-07edebe366eb tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:29.074685 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-29ad912b-2d33-46c2-8d35-07edebe366eb tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:29.078487 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-643e878c-c64e-474d-bf60-dec3d53a8c56 req-2dc60fa2-9573-4109-a0a9-9c1950d22cdc service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:29.078928 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-643e878c-c64e-474d-bf60-dec3d53a8c56 req-2dc60fa2-9573-4109-a0a9-9c1950d22cdc service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:29.081657 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-29ad912b-2d33-46c2-8d35-07edebe366eb tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:29.082174 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-29ad912b-2d33-46c2-8d35-07edebe366eb tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:29.083732 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-29ad912b-2d33-46c2-8d35-07edebe366eb tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:29.083732 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-29ad912b-2d33-46c2-8d35-07edebe366eb tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:29.093720 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-643e878c-c64e-474d-bf60-dec3d53a8c56 req-2dc60fa2-9573-4109-a0a9-9c1950d22cdc service nova] Creating event network-vif-deleted:e8262eaa-95f7-4e78-8938-ee6bbcfd541b for instance c75c0a0d-ba4c-4f60-8cfd-427581097267 on hv-cinder-84773 Jun 27 21:18:29.098789 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-643e878c-c64e-474d-bf60-dec3d53a8c56 req-2dc60fa2-9573-4109-a0a9-9c1950d22cdc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036980 Jun 27 21:18:29.099582 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 179/373] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:18:29.223055 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-29ad912b-2d33-46c2-8d35-07edebe366eb tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:29.230801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8fd2cdd5-c3cb-49d5-832d-f44186904b46 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:29.231362 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-29ad912b-2d33-46c2-8d35-07edebe366eb tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1260 microversion: 2.1 time: 0.170619 Jun 27 21:18:29.231513 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8fd2cdd5-c3cb-49d5-832d-f44186904b46 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:29.231958 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 195/374] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:29 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:29.238684 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8fd2cdd5-c3cb-49d5-832d-f44186904b46 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:29.239128 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8fd2cdd5-c3cb-49d5-832d-f44186904b46 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:29.239889 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8fd2cdd5-c3cb-49d5-832d-f44186904b46 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:29.240317 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8fd2cdd5-c3cb-49d5-832d-f44186904b46 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:29.384317 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8fd2cdd5-c3cb-49d5-832d-f44186904b46 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:29.392998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8fd2cdd5-c3cb-49d5-832d-f44186904b46 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:29.394478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8fd2cdd5-c3cb-49d5-832d-f44186904b46 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:29.395669 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8fd2cdd5-c3cb-49d5-832d-f44186904b46 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1743 microversion: 2.20 time: 0.169411 Jun 27 21:18:29.396288 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 180/375] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:29 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:29.693289 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d0e2206f-6ab0-4d07-8b07-ba663c412d88 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:29.694171 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d0e2206f-6ab0-4d07-8b07-ba663c412d88 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] [instance: c75c0a0d-ba4c-4f60-8cfd-427581097267] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:29.703321 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d0e2206f-6ab0-4d07-8b07-ba663c412d88 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:29.704052 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d0e2206f-6ab0-4d07-8b07-ba663c412d88 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:29.704873 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d0e2206f-6ab0-4d07-8b07-ba663c412d88 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:29.705519 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d0e2206f-6ab0-4d07-8b07-ba663c412d88 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:29.781611 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d0e2206f-6ab0-4d07-8b07-ba663c412d88 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ebda0ab7d045ce92da3d5512f30eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e09a9ddb84c7ea356c7df622281da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:29.791045 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d0e2206f-6ab0-4d07-8b07-ba663c412d88 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] 10.222.0.13 "GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267" status: 200 len: 1298 microversion: 2.1 time: 0.101585 Jun 27 21:18:29.791866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 196/376] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:29 2022] GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267 => generated 1298 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:29.960077 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-380a75ed-42f8-4afb-93fb-b47388a2a416 req-e6a55e1b-02f5-4007-b98e-1049b1e58e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b28fb7f-5684-4656-bd7c-b6d7d15790b1", "name": "network-vif-plugged", "status": "completed", "tag": "c722f6d7-3bed-4343-ad5e-1c84bfc3ac4e"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:29.970125 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-380a75ed-42f8-4afb-93fb-b47388a2a416 req-e6a55e1b-02f5-4007-b98e-1049b1e58e9c service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:29.970542 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-380a75ed-42f8-4afb-93fb-b47388a2a416 req-e6a55e1b-02f5-4007-b98e-1049b1e58e9c service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:29.982863 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-380a75ed-42f8-4afb-93fb-b47388a2a416 req-e6a55e1b-02f5-4007-b98e-1049b1e58e9c service nova] Creating event network-vif-plugged:c722f6d7-3bed-4343-ad5e-1c84bfc3ac4e for instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 on hv-cinder-84773 Jun 27 21:18:29.988083 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-380a75ed-42f8-4afb-93fb-b47388a2a416 req-e6a55e1b-02f5-4007-b98e-1049b1e58e9c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031726 Jun 27 21:18:29.988683 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 181/377] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:18:30.077323 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8edcd6e5-5c3e-41bd-83b2-35a7b64249a3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:30.078025 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-8edcd6e5-5c3e-41bd-83b2-35a7b64249a3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:30.082850 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-76d2b766-5a3a-4103-b9d3-2d7f0b20d1de tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:30.084166 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-76d2b766-5a3a-4103-b9d3-2d7f0b20d1de tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:30.084692 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8edcd6e5-5c3e-41bd-83b2-35a7b64249a3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:30.085182 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8edcd6e5-5c3e-41bd-83b2-35a7b64249a3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:30.086175 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8edcd6e5-5c3e-41bd-83b2-35a7b64249a3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:30.086988 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8edcd6e5-5c3e-41bd-83b2-35a7b64249a3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:30.096682 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76d2b766-5a3a-4103-b9d3-2d7f0b20d1de tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:30.097675 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76d2b766-5a3a-4103-b9d3-2d7f0b20d1de tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:30.099172 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76d2b766-5a3a-4103-b9d3-2d7f0b20d1de tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:30.100025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76d2b766-5a3a-4103-b9d3-2d7f0b20d1de tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:30.236632 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8edcd6e5-5c3e-41bd-83b2-35a7b64249a3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:30.247964 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8edcd6e5-5c3e-41bd-83b2-35a7b64249a3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1714 microversion: 2.1 time: 0.174484 Jun 27 21:18:30.248577 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 197/378] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:30 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1714 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:30.253576 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-dad7fb2c-10fc-48b1-8134-631d416ce7fa tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:30.254440 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-dad7fb2c-10fc-48b1-8134-631d416ce7fa tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:30.261127 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dad7fb2c-10fc-48b1-8134-631d416ce7fa tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:30.261570 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dad7fb2c-10fc-48b1-8134-631d416ce7fa tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:30.262333 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dad7fb2c-10fc-48b1-8134-631d416ce7fa tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:30.262760 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dad7fb2c-10fc-48b1-8134-631d416ce7fa tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:30.270366 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-76d2b766-5a3a-4103-b9d3-2d7f0b20d1de tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:30.278645 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-76d2b766-5a3a-4103-b9d3-2d7f0b20d1de tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2" status: 200 len: 1367 microversion: 2.1 time: 0.203996 Jun 27 21:18:30.279200 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 182/379] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:30 2022] GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:18:30.405221 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-dad7fb2c-10fc-48b1-8134-631d416ce7fa tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:30.413521 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-dad7fb2c-10fc-48b1-8134-631d416ce7fa tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1260 microversion: 2.1 time: 0.163453 Jun 27 21:18:30.414048 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0468dd05-cb1b-404e-bd0a-6ed46fdc6952 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:30.414973 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0468dd05-cb1b-404e-bd0a-6ed46fdc6952 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:30.421470 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0468dd05-cb1b-404e-bd0a-6ed46fdc6952 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:30.421914 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0468dd05-cb1b-404e-bd0a-6ed46fdc6952 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:30.422685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0468dd05-cb1b-404e-bd0a-6ed46fdc6952 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:30.422877 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 198/380] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:30 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:30.423445 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0468dd05-cb1b-404e-bd0a-6ed46fdc6952 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:30.573282 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0468dd05-cb1b-404e-bd0a-6ed46fdc6952 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:30.581594 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0468dd05-cb1b-404e-bd0a-6ed46fdc6952 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:30.583119 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0468dd05-cb1b-404e-bd0a-6ed46fdc6952 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:30.584289 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0468dd05-cb1b-404e-bd0a-6ed46fdc6952 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1743 microversion: 2.20 time: 0.174202 Jun 27 21:18:30.584852 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 183/381] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:30 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:30.811358 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8a0412e1-6cca-4737-bee0-133ab36bbb18 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:30.811931 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-8a0412e1-6cca-4737-bee0-133ab36bbb18 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] [instance: c75c0a0d-ba4c-4f60-8cfd-427581097267] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:30.819412 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8a0412e1-6cca-4737-bee0-133ab36bbb18 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:30.820071 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8a0412e1-6cca-4737-bee0-133ab36bbb18 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:30.821174 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8a0412e1-6cca-4737-bee0-133ab36bbb18 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:30.821662 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8a0412e1-6cca-4737-bee0-133ab36bbb18 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:30.855074 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8a0412e1-6cca-4737-bee0-133ab36bbb18 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:30.855487 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8a0412e1-6cca-4737-bee0-133ab36bbb18 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:30.855960 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-8a0412e1-6cca-4737-bee0-133ab36bbb18 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lazy-loading 'fault' on Instance uuid c75c0a0d-ba4c-4f60-8cfd-427581097267 {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:18:30.902074 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8a0412e1-6cca-4737-bee0-133ab36bbb18 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ebda0ab7d045ce92da3d5512f30eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e09a9ddb84c7ea356c7df622281da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:30.910372 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8a0412e1-6cca-4737-bee0-133ab36bbb18 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] 10.222.0.13 "GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267" status: 200 len: 1303 microversion: 2.1 time: 0.102922 Jun 27 21:18:30.910950 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 199/382] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:30 2022] GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:31.297089 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cc5ba2bd-1731-4167-bcf1-87b8b9155032 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:31.297694 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cc5ba2bd-1731-4167-bcf1-87b8b9155032 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:31.305946 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cc5ba2bd-1731-4167-bcf1-87b8b9155032 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:31.306428 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cc5ba2bd-1731-4167-bcf1-87b8b9155032 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:31.307214 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cc5ba2bd-1731-4167-bcf1-87b8b9155032 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:31.307649 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cc5ba2bd-1731-4167-bcf1-87b8b9155032 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:31.431598 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a4a976f7-e4b8-4ad7-9ea8-1cc60727e2ec tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:31.432205 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a4a976f7-e4b8-4ad7-9ea8-1cc60727e2ec tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:31.438574 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a4a976f7-e4b8-4ad7-9ea8-1cc60727e2ec tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:31.438924 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a4a976f7-e4b8-4ad7-9ea8-1cc60727e2ec tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:31.439675 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a4a976f7-e4b8-4ad7-9ea8-1cc60727e2ec tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:31.440089 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a4a976f7-e4b8-4ad7-9ea8-1cc60727e2ec tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:31.459425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cc5ba2bd-1731-4167-bcf1-87b8b9155032 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:31.467922 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cc5ba2bd-1731-4167-bcf1-87b8b9155032 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2" status: 200 len: 1556 microversion: 2.1 time: 0.175800 Jun 27 21:18:31.468814 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 184/383] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:31 2022] GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:31.484965 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0e49b10d-9570-4641-be59-13c7284a9d11 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:31.485492 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0e49b10d-9570-4641-be59-13c7284a9d11 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:31.491966 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e49b10d-9570-4641-be59-13c7284a9d11 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:31.492414 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e49b10d-9570-4641-be59-13c7284a9d11 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:31.493227 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e49b10d-9570-4641-be59-13c7284a9d11 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:31.493661 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e49b10d-9570-4641-be59-13c7284a9d11 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:31.583765 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0e49b10d-9570-4641-be59-13c7284a9d11 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103002 Jun 27 21:18:31.584385 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 185/384] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 27 21:18:31 2022] GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:18:31.604825 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fcd58102-5632-4025-acc4-526cecc85b1f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:31.605716 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fcd58102-5632-4025-acc4-526cecc85b1f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:31.614650 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a4a976f7-e4b8-4ad7-9ea8-1cc60727e2ec tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:31.624007 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a4a976f7-e4b8-4ad7-9ea8-1cc60727e2ec tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1260 microversion: 2.1 time: 0.197111 Jun 27 21:18:31.625844 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fcd58102-5632-4025-acc4-526cecc85b1f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:31.626474 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fcd58102-5632-4025-acc4-526cecc85b1f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:31.627427 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fcd58102-5632-4025-acc4-526cecc85b1f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:31.627848 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fcd58102-5632-4025-acc4-526cecc85b1f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:31.639028 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 200/385] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:31 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1260 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:31.900435 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fcd58102-5632-4025-acc4-526cecc85b1f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:31.909235 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fcd58102-5632-4025-acc4-526cecc85b1f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:31.910844 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fcd58102-5632-4025-acc4-526cecc85b1f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:31.912103 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fcd58102-5632-4025-acc4-526cecc85b1f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1743 microversion: 2.20 time: 0.312181 Jun 27 21:18:31.912838 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 186/386] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:31 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1743 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:18:31.927776 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1ab33ebf-ed7a-4e58-b1a5-594724197b22 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:31.928376 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1ab33ebf-ed7a-4e58-b1a5-594724197b22 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] [instance: c75c0a0d-ba4c-4f60-8cfd-427581097267] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:31.936149 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1ab33ebf-ed7a-4e58-b1a5-594724197b22 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:31.936598 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1ab33ebf-ed7a-4e58-b1a5-594724197b22 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:31.937508 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1ab33ebf-ed7a-4e58-b1a5-594724197b22 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:31.937997 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1ab33ebf-ed7a-4e58-b1a5-594724197b22 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:31.970837 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1ab33ebf-ed7a-4e58-b1a5-594724197b22 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:31.971472 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1ab33ebf-ed7a-4e58-b1a5-594724197b22 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:31.972016 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-1ab33ebf-ed7a-4e58-b1a5-594724197b22 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lazy-loading 'fault' on Instance uuid c75c0a0d-ba4c-4f60-8cfd-427581097267 {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:18:32.013432 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1ab33ebf-ed7a-4e58-b1a5-594724197b22 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ebda0ab7d045ce92da3d5512f30eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e09a9ddb84c7ea356c7df622281da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:32.021414 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1ab33ebf-ed7a-4e58-b1a5-594724197b22 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] 10.222.0.13 "GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267" status: 200 len: 1303 microversion: 2.1 time: 0.097453 Jun 27 21:18:32.021973 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 201/387] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:31 2022] GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:32.647989 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ce0b659c-cc6e-4f79-a491-807a9bda5826 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:32.649524 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ce0b659c-cc6e-4f79-a491-807a9bda5826 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:32.656234 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ce0b659c-cc6e-4f79-a491-807a9bda5826 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:32.656234 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ce0b659c-cc6e-4f79-a491-807a9bda5826 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:32.657589 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ce0b659c-cc6e-4f79-a491-807a9bda5826 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:32.657945 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ce0b659c-cc6e-4f79-a491-807a9bda5826 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:32.905258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ce0b659c-cc6e-4f79-a491-807a9bda5826 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:32.913130 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ce0b659c-cc6e-4f79-a491-807a9bda5826 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1260 microversion: 2.1 time: 0.269848 Jun 27 21:18:32.913924 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 187/388] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:32 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1260 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:32.930946 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-46bffca2-20e9-4057-85bf-edca564c7808 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:32.931738 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-46bffca2-20e9-4057-85bf-edca564c7808 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:32.938401 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-46bffca2-20e9-4057-85bf-edca564c7808 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:32.938846 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-46bffca2-20e9-4057-85bf-edca564c7808 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:32.939688 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-46bffca2-20e9-4057-85bf-edca564c7808 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:32.940411 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-46bffca2-20e9-4057-85bf-edca564c7808 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:33.040902 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-77408bfa-8a73-471f-a6db-f2ae7f25c744 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:33.041702 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-77408bfa-8a73-471f-a6db-f2ae7f25c744 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] [instance: c75c0a0d-ba4c-4f60-8cfd-427581097267] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:33.048388 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-77408bfa-8a73-471f-a6db-f2ae7f25c744 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:33.049093 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-77408bfa-8a73-471f-a6db-f2ae7f25c744 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:33.050039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-77408bfa-8a73-471f-a6db-f2ae7f25c744 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:33.050868 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-77408bfa-8a73-471f-a6db-f2ae7f25c744 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:33.076680 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-77408bfa-8a73-471f-a6db-f2ae7f25c744 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] HTTP exception thrown: Instance c75c0a0d-ba4c-4f60-8cfd-427581097267 could not be found. Jun 27 21:18:33.079508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-77408bfa-8a73-471f-a6db-f2ae7f25c744 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Request method failure captured: Jun 27 21:18:33.079508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267 HTTP/1.1 Jun 27 21:18:33.079508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:18:33.079508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:18:33.079508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:18:33.079508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:18:33.079508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:18:33.079508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:18:33.079508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:18:33.079508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:18:33.079508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh6Oyx9K3oOMpzcHiezODjM1GjCVfUgXl2Sxo59OnB44sBbrk3AdkL-oEWdbLDRDkwbz9SRMY6z9zLwzDMPLbQ-Lwdr8mV5elm8OURif8-oh-KyUX6fIMfWhY_TZ1SX0naxT26N8i0nZvPMWptN_-ZsMio7dc7LtQvycJ_WwV3f5-Bw Jun 27 21:18:33.079508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:18:33.079508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:18:33.079508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:18:33.079508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:18:33.079508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:18:33.079508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:18:33.079508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: fe9e09a9ddb84c7ea356c7df622281da Jun 27 21:18:33.079508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesNegativeTest-305022746 Jun 27 21:18:33.079508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:18:33.079508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:18:33.081103 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fe9e09a9ddb84c7ea356c7df622281da", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fe9e09a9ddb84c7ea356c7df622281da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fe9e09a9ddb84c7ea356c7df622281da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fe9e09a9ddb84c7ea356c7df622281da"}]}] Jun 27 21:18:33.081103 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesNegativeTest-305022746 Jun 27 21:18:33.081103 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: fe9e09a9ddb84c7ea356c7df622281da Jun 27 21:18:33.081103 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesNegativeTest-305022746 Jun 27 21:18:33.081103 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesNegativeTest-305022746-project Jun 27 21:18:33.081103 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:18:33.081103 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:18:33.081103 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: 40ebda0ab7d045ce92da3d5512f30eaa Jun 27 21:18:33.081103 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesNegativeTest-305022746-project Jun 27 21:18:33.081103 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:18:33.081103 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance c75c0a0d-ba4c-4f60-8cfd-427581097267 could not be found. Jun 27 21:18:33.081103 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': 'c75c0a0d-ba4c-4f60-8cfd-427581097267'} Jun 27 21:18:33.081849 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:18:33.081849 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:18:33.081849 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:18:33.081849 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:18:33.081849 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:18:33.081849 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:18:33.081849 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:18:33.081849 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:18:33.081849 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:18:33.081849 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:18:33.081849 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c75c0a0d-ba4c-4f60-8cfd-427581097267 could not be found. Jun 27 21:18:33.081849 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:18:33.081849 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:18:33.081849 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:18:33.081849 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:18:33.081849 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:18:33.081849 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:18:33.081849 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:18:33.081849 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:18:33.081849 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:18:33.083213 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:18:33.083213 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:18:33.083213 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:18:33.083213 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:18:33.083213 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:18:33.083213 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:18:33.083213 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:18:33.083213 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c75c0a0d-ba4c-4f60-8cfd-427581097267 could not be found. Jun 27 21:18:33.083213 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:18:33.083213 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:18:33.083213 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:18:33.083213 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:18:33.083213 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:18:33.083213 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:18:33.083213 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:18:33.083213 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:18:33.083213 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c75c0a0d-ba4c-4f60-8cfd-427581097267 could not be found. Jun 27 21:18:33.083213 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:18:33.087129 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-77408bfa-8a73-471f-a6db-f2ae7f25c744 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] Returning 404 to user: Instance c75c0a0d-ba4c-4f60-8cfd-427581097267 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:18:33.088606 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-77408bfa-8a73-471f-a6db-f2ae7f25c744 tempest-VolumesNegativeTest-305022746 tempest-VolumesNegativeTest-305022746-project] 10.222.0.13 "GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267" status: 404 len: 111 microversion: 2.1 time: 0.054040 Jun 27 21:18:33.089755 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 188/389] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:33 2022] GET /compute/v2.1/servers/c75c0a0d-ba4c-4f60-8cfd-427581097267 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:18:33.094839 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-6d9b865d-ac30-4d83-88d3-ea743e5eec3f req-979c94ac-6404-4e24-ad71-a7b67e3ac50c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c5b1522-b5e3-4328-9292-5f99591179a2", "tag": "63757cf8-adc3-4cb5-8c67-986e0c574946"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:33.106858 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-6d9b865d-ac30-4d83-88d3-ea743e5eec3f req-979c94ac-6404-4e24-ad71-a7b67e3ac50c service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:33.107652 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-6d9b865d-ac30-4d83-88d3-ea743e5eec3f req-979c94ac-6404-4e24-ad71-a7b67e3ac50c service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:33.122861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-6d9b865d-ac30-4d83-88d3-ea743e5eec3f req-979c94ac-6404-4e24-ad71-a7b67e3ac50c service nova] Creating event network-changed:63757cf8-adc3-4cb5-8c67-986e0c574946 for instance 3c5b1522-b5e3-4328-9292-5f99591179a2 on hv-cinder-84773 Jun 27 21:18:33.130459 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-6d9b865d-ac30-4d83-88d3-ea743e5eec3f req-979c94ac-6404-4e24-ad71-a7b67e3ac50c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039166 Jun 27 21:18:33.131785 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 189/390] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:18:33.143242 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-46bffca2-20e9-4057-85bf-edca564c7808 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:33.152740 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-46bffca2-20e9-4057-85bf-edca564c7808 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:33.155229 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-46bffca2-20e9-4057-85bf-edca564c7808 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:33.156795 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-46bffca2-20e9-4057-85bf-edca564c7808 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1738 microversion: 2.20 time: 0.230136 Jun 27 21:18:33.157537 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 202/391] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:32 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:33.948962 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-791f03ca-d2e6-420c-8d19-94c43ab76f00 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:33.956022 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-791f03ca-d2e6-420c-8d19-94c43ab76f00 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:33.965950 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-791f03ca-d2e6-420c-8d19-94c43ab76f00 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:33.966539 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-791f03ca-d2e6-420c-8d19-94c43ab76f00 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:33.967577 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-791f03ca-d2e6-420c-8d19-94c43ab76f00 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:33.968334 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-791f03ca-d2e6-420c-8d19-94c43ab76f00 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:34.180860 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-791f03ca-d2e6-420c-8d19-94c43ab76f00 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:34.183746 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8d160639-9e40-4fe1-b4f3-bf574e5d600b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:34.187209 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-8d160639-9e40-4fe1-b4f3-bf574e5d600b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:34.195278 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-791f03ca-d2e6-420c-8d19-94c43ab76f00 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1260 microversion: 2.1 time: 0.267005 Jun 27 21:18:34.197221 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 190/392] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:33 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1260 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:34.200954 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8d160639-9e40-4fe1-b4f3-bf574e5d600b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:34.201401 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8d160639-9e40-4fe1-b4f3-bf574e5d600b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:34.202204 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8d160639-9e40-4fe1-b4f3-bf574e5d600b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:34.202632 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8d160639-9e40-4fe1-b4f3-bf574e5d600b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:34.502056 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8d160639-9e40-4fe1-b4f3-bf574e5d600b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:34.512074 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8d160639-9e40-4fe1-b4f3-bf574e5d600b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:34.513917 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8d160639-9e40-4fe1-b4f3-bf574e5d600b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:34.518221 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8d160639-9e40-4fe1-b4f3-bf574e5d600b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1738 microversion: 2.20 time: 0.342045 Jun 27 21:18:34.519154 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 203/393] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:34 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1738 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:35.213676 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8dd48f0e-d47b-4ca7-af25-5d5b09e7cbd9 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:35.215094 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8dd48f0e-d47b-4ca7-af25-5d5b09e7cbd9 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:35.221773 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8dd48f0e-d47b-4ca7-af25-5d5b09e7cbd9 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:35.222209 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8dd48f0e-d47b-4ca7-af25-5d5b09e7cbd9 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:35.223067 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8dd48f0e-d47b-4ca7-af25-5d5b09e7cbd9 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:35.223396 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8dd48f0e-d47b-4ca7-af25-5d5b09e7cbd9 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:35.424970 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8dd48f0e-d47b-4ca7-af25-5d5b09e7cbd9 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:35.433763 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8dd48f0e-d47b-4ca7-af25-5d5b09e7cbd9 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1260 microversion: 2.1 time: 0.224459 Jun 27 21:18:35.435294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 191/394] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:35 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:35.541428 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5c1952d1-70fd-40d5-b744-efe9e875a3cc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:35.543252 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-5c1952d1-70fd-40d5-b744-efe9e875a3cc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:35.551803 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5c1952d1-70fd-40d5-b744-efe9e875a3cc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:35.553117 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5c1952d1-70fd-40d5-b744-efe9e875a3cc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:35.554124 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5c1952d1-70fd-40d5-b744-efe9e875a3cc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:35.554804 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5c1952d1-70fd-40d5-b744-efe9e875a3cc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:35.749740 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5c1952d1-70fd-40d5-b744-efe9e875a3cc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:35.764941 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5c1952d1-70fd-40d5-b744-efe9e875a3cc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:35.769448 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5c1952d1-70fd-40d5-b744-efe9e875a3cc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:35.771196 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5c1952d1-70fd-40d5-b744-efe9e875a3cc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1738 microversion: 2.20 time: 0.235091 Jun 27 21:18:35.772210 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 204/395] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:35 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:36.450723 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fd847f7f-2c5f-4b61-958e-e0b16c2580c4 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:36.451316 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fd847f7f-2c5f-4b61-958e-e0b16c2580c4 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:36.459792 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd847f7f-2c5f-4b61-958e-e0b16c2580c4 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:36.460597 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd847f7f-2c5f-4b61-958e-e0b16c2580c4 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:36.462134 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd847f7f-2c5f-4b61-958e-e0b16c2580c4 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:36.463852 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd847f7f-2c5f-4b61-958e-e0b16c2580c4 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:36.691322 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fd847f7f-2c5f-4b61-958e-e0b16c2580c4 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:36.705232 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fd847f7f-2c5f-4b61-958e-e0b16c2580c4 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1260 microversion: 2.1 time: 0.257939 Jun 27 21:18:36.712445 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 192/396] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:36 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1260 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:18:36.799662 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1d0dac28-2cd2-4b97-a66a-2daee99d0e9e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:36.800281 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1d0dac28-2cd2-4b97-a66a-2daee99d0e9e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:36.807698 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1d0dac28-2cd2-4b97-a66a-2daee99d0e9e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:36.808414 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1d0dac28-2cd2-4b97-a66a-2daee99d0e9e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:36.809239 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1d0dac28-2cd2-4b97-a66a-2daee99d0e9e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:36.809826 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1d0dac28-2cd2-4b97-a66a-2daee99d0e9e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:36.984211 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1d0dac28-2cd2-4b97-a66a-2daee99d0e9e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:36.986650 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=100 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:36.995354 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1d0dac28-2cd2-4b97-a66a-2daee99d0e9e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:37.002761 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1d0dac28-2cd2-4b97-a66a-2daee99d0e9e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:37.004702 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1d0dac28-2cd2-4b97-a66a-2daee99d0e9e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1738 microversion: 2.20 time: 0.209130 Jun 27 21:18:37.005924 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 205/397] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:36 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:37.728392 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e760fd9f-289a-4492-b6c0-edfdfaaa556b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:37.729768 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e760fd9f-289a-4492-b6c0-edfdfaaa556b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:37.741378 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e760fd9f-289a-4492-b6c0-edfdfaaa556b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:37.742526 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e760fd9f-289a-4492-b6c0-edfdfaaa556b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:37.743496 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e760fd9f-289a-4492-b6c0-edfdfaaa556b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:37.744092 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e760fd9f-289a-4492-b6c0-edfdfaaa556b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:37.912455 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e760fd9f-289a-4492-b6c0-edfdfaaa556b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:37.928519 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e760fd9f-289a-4492-b6c0-edfdfaaa556b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1260 microversion: 2.1 time: 0.204381 Jun 27 21:18:37.940877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 193/398] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:37 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1260 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:18:38.040097 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-961e4cd8-677e-4bf5-b5a0-115bcf6c53e7 req-97403099-dd15-4c84-8386-91f05c880044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9323a6ac-3a15-471a-b676-eb3e809a8637", "name": "network-vif-plugged", "status": "completed", "tag": "36112ae1-bee5-4df6-9469-82c6af7bb1f4"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:38.041999 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3ecc7a02-d879-46b5-852a-15295cbcd9be tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:38.045094 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3ecc7a02-d879-46b5-852a-15295cbcd9be tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:38.064089 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3ecc7a02-d879-46b5-852a-15295cbcd9be tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:38.064523 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3ecc7a02-d879-46b5-852a-15295cbcd9be tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:38.067911 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-961e4cd8-677e-4bf5-b5a0-115bcf6c53e7 req-97403099-dd15-4c84-8386-91f05c880044 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:38.068353 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-961e4cd8-677e-4bf5-b5a0-115bcf6c53e7 req-97403099-dd15-4c84-8386-91f05c880044 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:38.070481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3ecc7a02-d879-46b5-852a-15295cbcd9be tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:38.070919 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3ecc7a02-d879-46b5-852a-15295cbcd9be tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:38.097775 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-961e4cd8-677e-4bf5-b5a0-115bcf6c53e7 req-97403099-dd15-4c84-8386-91f05c880044 service nova] Creating event network-vif-plugged:36112ae1-bee5-4df6-9469-82c6af7bb1f4 for instance 9323a6ac-3a15-471a-b676-eb3e809a8637 on hv-cinder-84773 Jun 27 21:18:38.107831 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-961e4cd8-677e-4bf5-b5a0-115bcf6c53e7 req-97403099-dd15-4c84-8386-91f05c880044 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069867 Jun 27 21:18:38.108840 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 194/399] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:18:38.321970 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3ecc7a02-d879-46b5-852a-15295cbcd9be tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:38.337061 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3ecc7a02-d879-46b5-852a-15295cbcd9be tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:38.346871 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3ecc7a02-d879-46b5-852a-15295cbcd9be tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:38.349283 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3ecc7a02-d879-46b5-852a-15295cbcd9be tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1738 microversion: 2.20 time: 0.328995 Jun 27 21:18:38.364965 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 206/400] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:38 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1738 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:38.947615 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-89daeebb-5074-4936-b187-fca77a743b63 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:38.949237 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-89daeebb-5074-4936-b187-fca77a743b63 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:38.957295 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89daeebb-5074-4936-b187-fca77a743b63 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:38.958020 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89daeebb-5074-4936-b187-fca77a743b63 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:38.959017 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89daeebb-5074-4936-b187-fca77a743b63 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:38.959678 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89daeebb-5074-4936-b187-fca77a743b63 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:39.146422 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-89daeebb-5074-4936-b187-fca77a743b63 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:39.156177 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-89daeebb-5074-4936-b187-fca77a743b63 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1260 microversion: 2.1 time: 0.213170 Jun 27 21:18:39.167288 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 195/401] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:38 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:39.390052 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6e86815a-4c81-4e56-b9c3-466cf7fa9122 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:39.407084 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6e86815a-4c81-4e56-b9c3-466cf7fa9122 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:39.407084 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6e86815a-4c81-4e56-b9c3-466cf7fa9122 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:39.407084 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6e86815a-4c81-4e56-b9c3-466cf7fa9122 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:39.407084 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6e86815a-4c81-4e56-b9c3-466cf7fa9122 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:39.407397 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6e86815a-4c81-4e56-b9c3-466cf7fa9122 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:39.613866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-6e86815a-4c81-4e56-b9c3-466cf7fa9122 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:39.622706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-6e86815a-4c81-4e56-b9c3-466cf7fa9122 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:39.624242 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-6e86815a-4c81-4e56-b9c3-466cf7fa9122 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:39.626150 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6e86815a-4c81-4e56-b9c3-466cf7fa9122 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1738 microversion: 2.20 time: 0.242460 Jun 27 21:18:39.626473 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 207/402] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:39 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1738 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:40.174372 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a589b644-9c1a-4b0e-b82e-f560ea206598 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:40.175272 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a589b644-9c1a-4b0e-b82e-f560ea206598 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:40.181902 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a589b644-9c1a-4b0e-b82e-f560ea206598 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:40.182348 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a589b644-9c1a-4b0e-b82e-f560ea206598 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:40.183113 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a589b644-9c1a-4b0e-b82e-f560ea206598 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:40.183562 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a589b644-9c1a-4b0e-b82e-f560ea206598 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:40.328666 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a589b644-9c1a-4b0e-b82e-f560ea206598 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:40.337944 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a589b644-9c1a-4b0e-b82e-f560ea206598 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1260 microversion: 2.1 time: 0.167549 Jun 27 21:18:40.347707 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 196/403] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:40 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:40.646378 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-140506b2-f82d-4004-bc4f-c7a397359e93 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:40.647698 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-140506b2-f82d-4004-bc4f-c7a397359e93 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:40.655306 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-140506b2-f82d-4004-bc4f-c7a397359e93 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:40.656099 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-140506b2-f82d-4004-bc4f-c7a397359e93 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:40.657156 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-140506b2-f82d-4004-bc4f-c7a397359e93 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:40.657798 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-140506b2-f82d-4004-bc4f-c7a397359e93 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:40.807507 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-140506b2-f82d-4004-bc4f-c7a397359e93 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:40.817723 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-140506b2-f82d-4004-bc4f-c7a397359e93 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:40.820031 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-140506b2-f82d-4004-bc4f-c7a397359e93 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:40.821433 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-140506b2-f82d-4004-bc4f-c7a397359e93 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1738 microversion: 2.20 time: 0.180789 Jun 27 21:18:40.821831 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 208/404] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:40 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:41.354859 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-24a8f0ef-375b-4e17-8bf2-6adf68c8b756 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:41.356181 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-24a8f0ef-375b-4e17-8bf2-6adf68c8b756 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:41.363241 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-24a8f0ef-375b-4e17-8bf2-6adf68c8b756 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:41.363923 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-24a8f0ef-375b-4e17-8bf2-6adf68c8b756 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:41.364904 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-24a8f0ef-375b-4e17-8bf2-6adf68c8b756 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:41.365366 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-24a8f0ef-375b-4e17-8bf2-6adf68c8b756 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:41.386179 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:41.522013 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-24a8f0ef-375b-4e17-8bf2-6adf68c8b756 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:41.532657 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-24a8f0ef-375b-4e17-8bf2-6adf68c8b756 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1444 microversion: 2.1 time: 0.181801 Jun 27 21:18:41.543385 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 197/405] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:41 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1444 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:41.549255 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-edcfb5c3-d97b-4497-9999-670f91233918 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:41.550102 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-edcfb5c3-d97b-4497-9999-670f91233918 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:41.556701 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-edcfb5c3-d97b-4497-9999-670f91233918 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:41.557489 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-edcfb5c3-d97b-4497-9999-670f91233918 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:41.558475 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-edcfb5c3-d97b-4497-9999-670f91233918 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:41.559068 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-edcfb5c3-d97b-4497-9999-670f91233918 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:41.701762 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-edcfb5c3-d97b-4497-9999-670f91233918 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:41.710871 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-edcfb5c3-d97b-4497-9999-670f91233918 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1444 microversion: 2.1 time: 0.165356 Jun 27 21:18:41.711984 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 209/406] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:41 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1444 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:41.842288 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ee1f81ad-fb23-4bde-b061-cf4e3f54b78a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:41.842840 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ee1f81ad-fb23-4bde-b061-cf4e3f54b78a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:41.850604 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee1f81ad-fb23-4bde-b061-cf4e3f54b78a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:41.851279 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee1f81ad-fb23-4bde-b061-cf4e3f54b78a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:41.852091 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee1f81ad-fb23-4bde-b061-cf4e3f54b78a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:41.852530 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee1f81ad-fb23-4bde-b061-cf4e3f54b78a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:42.011511 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ee1f81ad-fb23-4bde-b061-cf4e3f54b78a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:42.019809 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ee1f81ad-fb23-4bde-b061-cf4e3f54b78a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:42.022750 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ee1f81ad-fb23-4bde-b061-cf4e3f54b78a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:42.024534 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ee1f81ad-fb23-4bde-b061-cf4e3f54b78a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1738 microversion: 2.20 time: 0.187664 Jun 27 21:18:42.035933 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 198/407] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:41 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:18:43.043378 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-99b7ce3f-72a6-4e51-a93a-c9805b7a9a78 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:43.043985 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-99b7ce3f-72a6-4e51-a93a-c9805b7a9a78 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:43.050708 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-99b7ce3f-72a6-4e51-a93a-c9805b7a9a78 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:43.051171 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-99b7ce3f-72a6-4e51-a93a-c9805b7a9a78 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:43.051921 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-99b7ce3f-72a6-4e51-a93a-c9805b7a9a78 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:43.052355 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-99b7ce3f-72a6-4e51-a93a-c9805b7a9a78 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:43.274044 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-99b7ce3f-72a6-4e51-a93a-c9805b7a9a78 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:43.283013 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-99b7ce3f-72a6-4e51-a93a-c9805b7a9a78 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:43.284561 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-99b7ce3f-72a6-4e51-a93a-c9805b7a9a78 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:43.285706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-99b7ce3f-72a6-4e51-a93a-c9805b7a9a78 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1738 microversion: 2.20 time: 0.246712 Jun 27 21:18:43.286272 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 210/408] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:43 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:44.089606 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-c0c2a72d-ca87-48e4-95cc-693baf80cd68 req-1e996653-b8eb-42bb-943a-052470f9b3e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9323a6ac-3a15-471a-b676-eb3e809a8637", "tag": "36112ae1-bee5-4df6-9469-82c6af7bb1f4"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:44.098080 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-c0c2a72d-ca87-48e4-95cc-693baf80cd68 req-1e996653-b8eb-42bb-943a-052470f9b3e2 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:44.098841 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-c0c2a72d-ca87-48e4-95cc-693baf80cd68 req-1e996653-b8eb-42bb-943a-052470f9b3e2 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:44.110436 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-c0c2a72d-ca87-48e4-95cc-693baf80cd68 req-1e996653-b8eb-42bb-943a-052470f9b3e2 service nova] Creating event network-changed:36112ae1-bee5-4df6-9469-82c6af7bb1f4 for instance 9323a6ac-3a15-471a-b676-eb3e809a8637 on hv-cinder-84773 Jun 27 21:18:44.116192 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-c0c2a72d-ca87-48e4-95cc-693baf80cd68 req-1e996653-b8eb-42bb-943a-052470f9b3e2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030814 Jun 27 21:18:44.116910 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 199/409] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:18:44.303816 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1729bb6b-4b44-47f1-9f04-3011b66527c8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:44.305154 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1729bb6b-4b44-47f1-9f04-3011b66527c8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:44.312557 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1729bb6b-4b44-47f1-9f04-3011b66527c8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:44.313028 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1729bb6b-4b44-47f1-9f04-3011b66527c8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:44.313791 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1729bb6b-4b44-47f1-9f04-3011b66527c8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:44.314413 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1729bb6b-4b44-47f1-9f04-3011b66527c8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:44.459189 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1729bb6b-4b44-47f1-9f04-3011b66527c8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:44.470032 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1729bb6b-4b44-47f1-9f04-3011b66527c8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:44.472124 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1729bb6b-4b44-47f1-9f04-3011b66527c8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:44.474163 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1729bb6b-4b44-47f1-9f04-3011b66527c8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1720 microversion: 2.20 time: 0.174437 Jun 27 21:18:44.475897 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 211/410] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:44 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:45.495609 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ab790cdf-b917-4724-b2b0-72867d5603ee tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:45.496345 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ab790cdf-b917-4724-b2b0-72867d5603ee tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:45.503288 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab790cdf-b917-4724-b2b0-72867d5603ee tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:45.503732 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab790cdf-b917-4724-b2b0-72867d5603ee tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:45.504480 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab790cdf-b917-4724-b2b0-72867d5603ee tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:45.504917 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab790cdf-b917-4724-b2b0-72867d5603ee tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:45.643248 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ab790cdf-b917-4724-b2b0-72867d5603ee tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:45.652001 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ab790cdf-b917-4724-b2b0-72867d5603ee tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:45.653454 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ab790cdf-b917-4724-b2b0-72867d5603ee tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:45.654625 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ab790cdf-b917-4724-b2b0-72867d5603ee tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1720 microversion: 2.20 time: 0.164067 Jun 27 21:18:45.655371 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 200/411] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:45 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:46.674328 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-29ba02f7-d322-4400-9158-3f76573dd049 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:46.675780 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-29ba02f7-d322-4400-9158-3f76573dd049 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:46.683193 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-29ba02f7-d322-4400-9158-3f76573dd049 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:46.683612 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-29ba02f7-d322-4400-9158-3f76573dd049 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:46.684418 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-29ba02f7-d322-4400-9158-3f76573dd049 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:46.684853 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-29ba02f7-d322-4400-9158-3f76573dd049 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:46.828157 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-29ba02f7-d322-4400-9158-3f76573dd049 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:46.837152 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-29ba02f7-d322-4400-9158-3f76573dd049 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:46.838661 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-29ba02f7-d322-4400-9158-3f76573dd049 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:46.839824 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-29ba02f7-d322-4400-9158-3f76573dd049 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1720 microversion: 2.20 time: 0.169448 Jun 27 21:18:46.840475 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 212/412] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:46 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:47.862151 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1ca07dd2-0e78-487c-a791-dc0c04c56721 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:47.862738 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1ca07dd2-0e78-487c-a791-dc0c04c56721 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:47.870158 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1ca07dd2-0e78-487c-a791-dc0c04c56721 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:47.870603 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1ca07dd2-0e78-487c-a791-dc0c04c56721 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:47.871401 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1ca07dd2-0e78-487c-a791-dc0c04c56721 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:47.871865 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1ca07dd2-0e78-487c-a791-dc0c04c56721 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:48.004437 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-5e7d7217-abb7-4778-b052-e96c6de53663 req-cf54871e-6c0f-44e4-b808-ab49b045c98d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b28fb7f-5684-4656-bd7c-b6d7d15790b1", "name": "network-vif-unplugged", "status": "completed", "tag": "c722f6d7-3bed-4343-ad5e-1c84bfc3ac4e"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:48.013601 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1ca07dd2-0e78-487c-a791-dc0c04c56721 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:48.016050 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-5e7d7217-abb7-4778-b052-e96c6de53663 req-cf54871e-6c0f-44e4-b808-ab49b045c98d service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:48.016710 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-5e7d7217-abb7-4778-b052-e96c6de53663 req-cf54871e-6c0f-44e4-b808-ab49b045c98d service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:48.022396 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1ca07dd2-0e78-487c-a791-dc0c04c56721 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:48.023989 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1ca07dd2-0e78-487c-a791-dc0c04c56721 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:48.025673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1ca07dd2-0e78-487c-a791-dc0c04c56721 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1663 microversion: 2.20 time: 0.170760 Jun 27 21:18:48.038184 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 201/413] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:47 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1663 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:48.044028 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-82e90465-06a0-4fd0-8843-5d0552dbf479 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a64669da-c04e-474b-8842-eb58dda7310c"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:48.045594 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-82e90465-06a0-4fd0-8843-5d0552dbf479 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:48.051905 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.compute.server_external_events [req-5e7d7217-abb7-4778-b052-e96c6de53663 req-cf54871e-6c0f-44e4-b808-ab49b045c98d service nova] Unable to find a host for instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1. Dropping event network-vif-unplugged {{(pid=117891) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 27 21:18:48.052598 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-82e90465-06a0-4fd0-8843-5d0552dbf479 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:48.052808 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-5e7d7217-abb7-4778-b052-e96c6de53663 req-cf54871e-6c0f-44e4-b808-ab49b045c98d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.053198 Jun 27 21:18:48.053127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-82e90465-06a0-4fd0-8843-5d0552dbf479 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:48.053832 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 213/414] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 27 21:18:48.053980 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-82e90465-06a0-4fd0-8843-5d0552dbf479 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:48.055135 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-82e90465-06a0-4fd0-8843-5d0552dbf479 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:48.379817 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-82e90465-06a0-4fd0-8843-5d0552dbf479 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "POST /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.339942 Jun 27 21:18:48.380552 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 202/415] 10.222.0.13 () {62 vars in 1363 bytes} [Mon Jun 27 21:18:48 2022] POST /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1/os-volume_attachments => generated 188 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:18:48.518857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9e8d0daf-1093-4ada-8a2d-7d87b5fabd3b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:48.519982 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9e8d0daf-1093-4ada-8a2d-7d87b5fabd3b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:48.527316 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9e8d0daf-1093-4ada-8a2d-7d87b5fabd3b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:48.527759 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9e8d0daf-1093-4ada-8a2d-7d87b5fabd3b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:48.528535 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9e8d0daf-1093-4ada-8a2d-7d87b5fabd3b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:48.528959 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9e8d0daf-1093-4ada-8a2d-7d87b5fabd3b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:48.640309 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9e8d0daf-1093-4ada-8a2d-7d87b5fabd3b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "POST /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1/action" status: 202 len: 0 microversion: 2.20 time: 0.125736 Jun 27 21:18:48.640569 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 214/416] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jun 27 21:18:48 2022] POST /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:18:48.649758 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5d46c7fe-2b15-4f82-86d8-0e98b8a609e2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:48.650449 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5d46c7fe-2b15-4f82-86d8-0e98b8a609e2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:48.655202 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:48.662054 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d46c7fe-2b15-4f82-86d8-0e98b8a609e2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:48.662516 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d46c7fe-2b15-4f82-86d8-0e98b8a609e2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:48.663296 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d46c7fe-2b15-4f82-86d8-0e98b8a609e2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:48.663958 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d46c7fe-2b15-4f82-86d8-0e98b8a609e2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:48.826630 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5d46c7fe-2b15-4f82-86d8-0e98b8a609e2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:48.839756 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5d46c7fe-2b15-4f82-86d8-0e98b8a609e2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:48.842147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5d46c7fe-2b15-4f82-86d8-0e98b8a609e2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:48.843948 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5d46c7fe-2b15-4f82-86d8-0e98b8a609e2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1749 microversion: 2.20 time: 0.198453 Jun 27 21:18:48.844784 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 203/417] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:48 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1749 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:49.868954 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d64502f6-b1e8-4cd3-9869-ead29be81056 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:49.869660 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d64502f6-b1e8-4cd3-9869-ead29be81056 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:49.879375 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d64502f6-b1e8-4cd3-9869-ead29be81056 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:49.880125 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d64502f6-b1e8-4cd3-9869-ead29be81056 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:49.881300 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d64502f6-b1e8-4cd3-9869-ead29be81056 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:49.882015 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d64502f6-b1e8-4cd3-9869-ead29be81056 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:50.039749 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d64502f6-b1e8-4cd3-9869-ead29be81056 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:50.049048 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d64502f6-b1e8-4cd3-9869-ead29be81056 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:50.050551 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d64502f6-b1e8-4cd3-9869-ead29be81056 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:50.051736 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d64502f6-b1e8-4cd3-9869-ead29be81056 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1749 microversion: 2.20 time: 0.187706 Jun 27 21:18:50.052298 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 215/418] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:49 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1749 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:51.071342 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d64c096a-a675-459a-8e15-27b9162791e7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:51.071960 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d64c096a-a675-459a-8e15-27b9162791e7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:51.079083 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d64c096a-a675-459a-8e15-27b9162791e7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:51.079539 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d64c096a-a675-459a-8e15-27b9162791e7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:51.080327 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d64c096a-a675-459a-8e15-27b9162791e7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:51.080759 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d64c096a-a675-459a-8e15-27b9162791e7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:51.227538 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d64c096a-a675-459a-8e15-27b9162791e7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:51.236423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d64c096a-a675-459a-8e15-27b9162791e7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:51.237999 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d64c096a-a675-459a-8e15-27b9162791e7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:51.239234 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d64c096a-a675-459a-8e15-27b9162791e7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.172181 Jun 27 21:18:51.239792 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 204/419] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:51 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:52.259407 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e833654f-ff4f-4239-a38d-ac1d57f58276 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:52.260094 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e833654f-ff4f-4239-a38d-ac1d57f58276 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:52.267113 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e833654f-ff4f-4239-a38d-ac1d57f58276 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:52.267652 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e833654f-ff4f-4239-a38d-ac1d57f58276 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:52.268529 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e833654f-ff4f-4239-a38d-ac1d57f58276 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:52.269678 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e833654f-ff4f-4239-a38d-ac1d57f58276 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:52.423245 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e833654f-ff4f-4239-a38d-ac1d57f58276 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:52.433982 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e833654f-ff4f-4239-a38d-ac1d57f58276 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:52.435574 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e833654f-ff4f-4239-a38d-ac1d57f58276 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:52.437280 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e833654f-ff4f-4239-a38d-ac1d57f58276 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.182698 Jun 27 21:18:52.438084 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 216/420] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:52 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:53.461936 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8f8ce9c8-ec50-4192-b13a-f12c25b21dce tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:53.462895 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8f8ce9c8-ec50-4192-b13a-f12c25b21dce tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:53.470566 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f8ce9c8-ec50-4192-b13a-f12c25b21dce tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:53.471084 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f8ce9c8-ec50-4192-b13a-f12c25b21dce tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:53.472010 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f8ce9c8-ec50-4192-b13a-f12c25b21dce tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:53.472476 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f8ce9c8-ec50-4192-b13a-f12c25b21dce tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:53.655847 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8f8ce9c8-ec50-4192-b13a-f12c25b21dce tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:53.666623 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8f8ce9c8-ec50-4192-b13a-f12c25b21dce tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:53.668331 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8f8ce9c8-ec50-4192-b13a-f12c25b21dce tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:53.669686 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8f8ce9c8-ec50-4192-b13a-f12c25b21dce tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.214888 Jun 27 21:18:53.670319 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 205/421] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:53 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:54.690181 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-af8b3b80-47a9-4eeb-964c-58fb716508d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:54.690820 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-af8b3b80-47a9-4eeb-964c-58fb716508d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:54.717843 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-af8b3b80-47a9-4eeb-964c-58fb716508d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:54.718556 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-af8b3b80-47a9-4eeb-964c-58fb716508d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:54.719940 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-af8b3b80-47a9-4eeb-964c-58fb716508d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:54.720600 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-af8b3b80-47a9-4eeb-964c-58fb716508d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:54.926964 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-af8b3b80-47a9-4eeb-964c-58fb716508d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:54.939267 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-af8b3b80-47a9-4eeb-964c-58fb716508d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:54.941029 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-af8b3b80-47a9-4eeb-964c-58fb716508d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:54.942303 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-af8b3b80-47a9-4eeb-964c-58fb716508d1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.256805 Jun 27 21:18:54.943010 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 217/422] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:54 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:18:55.963320 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7fec1e58-14fa-404e-b44b-55ee6d62fad8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:55.963970 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7fec1e58-14fa-404e-b44b-55ee6d62fad8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:55.970693 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7fec1e58-14fa-404e-b44b-55ee6d62fad8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:55.971127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7fec1e58-14fa-404e-b44b-55ee6d62fad8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:55.971899 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7fec1e58-14fa-404e-b44b-55ee6d62fad8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:55.972319 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7fec1e58-14fa-404e-b44b-55ee6d62fad8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:56.140783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7fec1e58-14fa-404e-b44b-55ee6d62fad8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:56.151311 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7fec1e58-14fa-404e-b44b-55ee6d62fad8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:56.152717 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7fec1e58-14fa-404e-b44b-55ee6d62fad8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:56.154018 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7fec1e58-14fa-404e-b44b-55ee6d62fad8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.195361 Jun 27 21:18:56.154715 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 206/423] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:55 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:57.174074 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-df08a29b-2bad-453f-aed2-56e3f9dc42ef tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:57.174797 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-df08a29b-2bad-453f-aed2-56e3f9dc42ef tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:57.182806 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-df08a29b-2bad-453f-aed2-56e3f9dc42ef tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:57.183275 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-df08a29b-2bad-453f-aed2-56e3f9dc42ef tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:57.184089 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-df08a29b-2bad-453f-aed2-56e3f9dc42ef tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:57.184530 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-df08a29b-2bad-453f-aed2-56e3f9dc42ef tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:57.370154 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-df08a29b-2bad-453f-aed2-56e3f9dc42ef tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:57.382061 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-df08a29b-2bad-453f-aed2-56e3f9dc42ef tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:57.383811 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-df08a29b-2bad-453f-aed2-56e3f9dc42ef tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:57.385080 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-df08a29b-2bad-453f-aed2-56e3f9dc42ef tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.215316 Jun 27 21:18:57.385701 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 218/424] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:57 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:58.409027 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-71e66b15-2131-4727-990f-78adce4e18dc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:58.413109 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-71e66b15-2131-4727-990f-78adce4e18dc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:58.423018 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-71e66b15-2131-4727-990f-78adce4e18dc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:58.423608 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-71e66b15-2131-4727-990f-78adce4e18dc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:58.424629 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-71e66b15-2131-4727-990f-78adce4e18dc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:58.425053 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-71e66b15-2131-4727-990f-78adce4e18dc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:58.583530 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-71e66b15-2131-4727-990f-78adce4e18dc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:58.596843 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-71e66b15-2131-4727-990f-78adce4e18dc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:58.598777 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-71e66b15-2131-4727-990f-78adce4e18dc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:58.601542 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-71e66b15-2131-4727-990f-78adce4e18dc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.199853 Jun 27 21:18:58.602741 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 207/425] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:58 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:59.625314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ffdc93af-6ddc-4535-b452-db24f578987a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:59.626492 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ffdc93af-6ddc-4535-b452-db24f578987a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:59.631445 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=60 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:59.639527 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ffdc93af-6ddc-4535-b452-db24f578987a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:59.640436 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ffdc93af-6ddc-4535-b452-db24f578987a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:59.641971 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ffdc93af-6ddc-4535-b452-db24f578987a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:59.642838 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ffdc93af-6ddc-4535-b452-db24f578987a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:59.838070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ffdc93af-6ddc-4535-b452-db24f578987a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:59.854871 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ffdc93af-6ddc-4535-b452-db24f578987a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:59.857864 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ffdc93af-6ddc-4535-b452-db24f578987a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:59.859766 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ffdc93af-6ddc-4535-b452-db24f578987a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.242903 Jun 27 21:18:59.860464 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 219/426] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:59 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:00.892778 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1d3ac301-30d6-4b67-abcb-785ba70bcb8d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:00.894414 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1d3ac301-30d6-4b67-abcb-785ba70bcb8d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:00.902237 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1d3ac301-30d6-4b67-abcb-785ba70bcb8d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:00.902768 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1d3ac301-30d6-4b67-abcb-785ba70bcb8d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:00.904730 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1d3ac301-30d6-4b67-abcb-785ba70bcb8d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:00.905235 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1d3ac301-30d6-4b67-abcb-785ba70bcb8d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:01.070868 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1d3ac301-30d6-4b67-abcb-785ba70bcb8d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:01.084289 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1d3ac301-30d6-4b67-abcb-785ba70bcb8d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:01.087050 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1d3ac301-30d6-4b67-abcb-785ba70bcb8d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:01.088716 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1d3ac301-30d6-4b67-abcb-785ba70bcb8d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.202833 Jun 27 21:19:01.089734 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 208/427] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:00 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:02.113121 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f0cd3e4f-5804-4d4d-99db-c328f0f654fe tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:02.113770 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f0cd3e4f-5804-4d4d-99db-c328f0f654fe tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:02.121786 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f0cd3e4f-5804-4d4d-99db-c328f0f654fe tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:02.122275 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f0cd3e4f-5804-4d4d-99db-c328f0f654fe tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:02.123130 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f0cd3e4f-5804-4d4d-99db-c328f0f654fe tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:02.123583 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f0cd3e4f-5804-4d4d-99db-c328f0f654fe tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:02.316251 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f0cd3e4f-5804-4d4d-99db-c328f0f654fe tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:02.326384 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f0cd3e4f-5804-4d4d-99db-c328f0f654fe tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:02.327983 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f0cd3e4f-5804-4d4d-99db-c328f0f654fe tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:02.329234 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f0cd3e4f-5804-4d4d-99db-c328f0f654fe tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.220219 Jun 27 21:19:02.330179 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 220/428] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:02 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:03.351202 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3dfef7b8-d58a-44c4-8cf4-60d32d71fc2b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:03.353072 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3dfef7b8-d58a-44c4-8cf4-60d32d71fc2b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:03.361527 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3dfef7b8-d58a-44c4-8cf4-60d32d71fc2b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:03.361972 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3dfef7b8-d58a-44c4-8cf4-60d32d71fc2b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:03.363049 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3dfef7b8-d58a-44c4-8cf4-60d32d71fc2b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:03.363521 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3dfef7b8-d58a-44c4-8cf4-60d32d71fc2b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:03.525252 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3dfef7b8-d58a-44c4-8cf4-60d32d71fc2b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:03.537615 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3dfef7b8-d58a-44c4-8cf4-60d32d71fc2b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:03.540473 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3dfef7b8-d58a-44c4-8cf4-60d32d71fc2b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:03.541935 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3dfef7b8-d58a-44c4-8cf4-60d32d71fc2b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.195497 Jun 27 21:19:03.542616 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 209/429] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:03 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:04.561098 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-edab765e-86ba-40fc-a531-c4ca27d9b6d7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:04.561841 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-edab765e-86ba-40fc-a531-c4ca27d9b6d7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:04.568731 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-edab765e-86ba-40fc-a531-c4ca27d9b6d7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:04.569215 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-edab765e-86ba-40fc-a531-c4ca27d9b6d7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:04.570167 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-edab765e-86ba-40fc-a531-c4ca27d9b6d7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:04.570551 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-edab765e-86ba-40fc-a531-c4ca27d9b6d7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:04.717669 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-edab765e-86ba-40fc-a531-c4ca27d9b6d7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:04.727013 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-edab765e-86ba-40fc-a531-c4ca27d9b6d7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:04.728524 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-edab765e-86ba-40fc-a531-c4ca27d9b6d7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:04.729743 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-edab765e-86ba-40fc-a531-c4ca27d9b6d7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.172689 Jun 27 21:19:04.730314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 221/430] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:04 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:05.751014 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-617d70e6-886c-4ac0-a352-5803834a50db tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:05.751681 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-617d70e6-886c-4ac0-a352-5803834a50db tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:05.758448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-617d70e6-886c-4ac0-a352-5803834a50db tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:05.758913 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-617d70e6-886c-4ac0-a352-5803834a50db tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:05.759669 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-617d70e6-886c-4ac0-a352-5803834a50db tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:05.760101 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-617d70e6-886c-4ac0-a352-5803834a50db tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:05.904024 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-617d70e6-886c-4ac0-a352-5803834a50db tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:05.912648 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-617d70e6-886c-4ac0-a352-5803834a50db tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:05.914296 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-617d70e6-886c-4ac0-a352-5803834a50db tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:05.915474 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-617d70e6-886c-4ac0-a352-5803834a50db tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.168429 Jun 27 21:19:05.916037 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 210/431] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:05 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:06.935128 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ce422bd1-e4dc-4586-852b-8c2c9d1ef1dd tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:06.935797 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ce422bd1-e4dc-4586-852b-8c2c9d1ef1dd tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:06.942824 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ce422bd1-e4dc-4586-852b-8c2c9d1ef1dd tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:06.943270 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ce422bd1-e4dc-4586-852b-8c2c9d1ef1dd tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:06.944027 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ce422bd1-e4dc-4586-852b-8c2c9d1ef1dd tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:06.944679 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ce422bd1-e4dc-4586-852b-8c2c9d1ef1dd tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:06.947289 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:07.081390 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ce422bd1-e4dc-4586-852b-8c2c9d1ef1dd tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:07.090749 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ce422bd1-e4dc-4586-852b-8c2c9d1ef1dd tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:07.092228 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ce422bd1-e4dc-4586-852b-8c2c9d1ef1dd tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:07.093451 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ce422bd1-e4dc-4586-852b-8c2c9d1ef1dd tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.162312 Jun 27 21:19:07.094009 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 222/432] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:06 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:08.112592 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a54a9c12-2c94-4680-a5c6-33efa1a7d979 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:08.113362 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a54a9c12-2c94-4680-a5c6-33efa1a7d979 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:08.120394 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a54a9c12-2c94-4680-a5c6-33efa1a7d979 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:08.120837 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a54a9c12-2c94-4680-a5c6-33efa1a7d979 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:08.121634 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a54a9c12-2c94-4680-a5c6-33efa1a7d979 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:08.122065 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a54a9c12-2c94-4680-a5c6-33efa1a7d979 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:08.260000 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a54a9c12-2c94-4680-a5c6-33efa1a7d979 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:08.269203 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a54a9c12-2c94-4680-a5c6-33efa1a7d979 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:08.270800 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a54a9c12-2c94-4680-a5c6-33efa1a7d979 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:08.271908 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a54a9c12-2c94-4680-a5c6-33efa1a7d979 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.163647 Jun 27 21:19:08.272478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 211/433] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:08 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:09.290772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-bb0410f7-6b00-4052-8e3d-8c5ebca2de05 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:09.291387 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-bb0410f7-6b00-4052-8e3d-8c5ebca2de05 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:09.298516 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bb0410f7-6b00-4052-8e3d-8c5ebca2de05 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:09.298962 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bb0410f7-6b00-4052-8e3d-8c5ebca2de05 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:09.299727 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bb0410f7-6b00-4052-8e3d-8c5ebca2de05 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:09.300160 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bb0410f7-6b00-4052-8e3d-8c5ebca2de05 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:09.439930 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-bb0410f7-6b00-4052-8e3d-8c5ebca2de05 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:09.451246 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-bb0410f7-6b00-4052-8e3d-8c5ebca2de05 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:09.453749 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-bb0410f7-6b00-4052-8e3d-8c5ebca2de05 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:09.454957 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-bb0410f7-6b00-4052-8e3d-8c5ebca2de05 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.168466 Jun 27 21:19:09.455520 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 223/434] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:09 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:10.430199 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-309ceafd-6e62-47f6-9ed6-d02abe033133 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be27b8ca-3335-4629-8b9d-c8fea9780a2b"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:10.431367 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-309ceafd-6e62-47f6-9ed6-d02abe033133 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:10.438591 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-309ceafd-6e62-47f6-9ed6-d02abe033133 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:10.439365 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-309ceafd-6e62-47f6-9ed6-d02abe033133 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:10.439773 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-309ceafd-6e62-47f6-9ed6-d02abe033133 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:10.440197 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-309ceafd-6e62-47f6-9ed6-d02abe033133 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:10.444304 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:10.476763 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-73b17038-a1aa-4e00-abfc-c5608282d3d5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:10.477373 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-73b17038-a1aa-4e00-abfc-c5608282d3d5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:10.484077 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-73b17038-a1aa-4e00-abfc-c5608282d3d5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:10.484612 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-73b17038-a1aa-4e00-abfc-c5608282d3d5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:10.485502 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-73b17038-a1aa-4e00-abfc-c5608282d3d5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:10.485998 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-73b17038-a1aa-4e00-abfc-c5608282d3d5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:10.623303 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-73b17038-a1aa-4e00-abfc-c5608282d3d5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:10.632269 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-73b17038-a1aa-4e00-abfc-c5608282d3d5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:10.633825 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-73b17038-a1aa-4e00-abfc-c5608282d3d5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:10.634994 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-73b17038-a1aa-4e00-abfc-c5608282d3d5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.163118 Jun 27 21:19:10.635560 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 224/435] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:10 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:10.722720 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-309ceafd-6e62-47f6-9ed6-d02abe033133 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "POST /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296704 Jun 27 21:19:10.723362 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 212/436] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 27 21:19:10 2022] POST /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:11.654191 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a567ecc6-7896-4f21-b43e-30b4389eb003 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:11.654788 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a567ecc6-7896-4f21-b43e-30b4389eb003 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:11.661838 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a567ecc6-7896-4f21-b43e-30b4389eb003 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:11.662284 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a567ecc6-7896-4f21-b43e-30b4389eb003 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:11.663104 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a567ecc6-7896-4f21-b43e-30b4389eb003 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:11.663547 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a567ecc6-7896-4f21-b43e-30b4389eb003 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:11.828673 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a567ecc6-7896-4f21-b43e-30b4389eb003 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:11.841487 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a567ecc6-7896-4f21-b43e-30b4389eb003 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:11.842994 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a567ecc6-7896-4f21-b43e-30b4389eb003 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:11.844188 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a567ecc6-7896-4f21-b43e-30b4389eb003 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.194134 Jun 27 21:19:11.844754 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 225/437] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:11 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:12.864977 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4ef01412-92ce-437b-a5f2-ff22ada4c220 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:12.866073 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4ef01412-92ce-437b-a5f2-ff22ada4c220 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:12.875353 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ef01412-92ce-437b-a5f2-ff22ada4c220 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:12.875960 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ef01412-92ce-437b-a5f2-ff22ada4c220 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:12.876784 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ef01412-92ce-437b-a5f2-ff22ada4c220 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:12.877429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ef01412-92ce-437b-a5f2-ff22ada4c220 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:13.021857 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4ef01412-92ce-437b-a5f2-ff22ada4c220 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:13.034978 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4ef01412-92ce-437b-a5f2-ff22ada4c220 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:13.036464 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4ef01412-92ce-437b-a5f2-ff22ada4c220 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:13.037667 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4ef01412-92ce-437b-a5f2-ff22ada4c220 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.178296 Jun 27 21:19:13.038240 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 213/438] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:12 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:14.056150 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7fd9ced1-4d0a-4753-b224-0d3710939583 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:14.056719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7fd9ced1-4d0a-4753-b224-0d3710939583 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:14.063552 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7fd9ced1-4d0a-4753-b224-0d3710939583 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:14.064000 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7fd9ced1-4d0a-4753-b224-0d3710939583 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:14.064777 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7fd9ced1-4d0a-4753-b224-0d3710939583 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:14.065233 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7fd9ced1-4d0a-4753-b224-0d3710939583 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:14.209400 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7fd9ced1-4d0a-4753-b224-0d3710939583 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:14.219905 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7fd9ced1-4d0a-4753-b224-0d3710939583 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:14.221444 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7fd9ced1-4d0a-4753-b224-0d3710939583 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:14.222635 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7fd9ced1-4d0a-4753-b224-0d3710939583 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.170711 Jun 27 21:19:14.223228 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 226/439] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:14 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:15.241690 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f6ab5f2b-f5ef-4e8e-811b-b40ff08bd385 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:15.242269 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f6ab5f2b-f5ef-4e8e-811b-b40ff08bd385 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:15.249411 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6ab5f2b-f5ef-4e8e-811b-b40ff08bd385 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:15.249853 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6ab5f2b-f5ef-4e8e-811b-b40ff08bd385 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:15.250619 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6ab5f2b-f5ef-4e8e-811b-b40ff08bd385 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:15.251041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6ab5f2b-f5ef-4e8e-811b-b40ff08bd385 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:15.405692 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f6ab5f2b-f5ef-4e8e-811b-b40ff08bd385 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:15.417807 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f6ab5f2b-f5ef-4e8e-811b-b40ff08bd385 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:15.419337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f6ab5f2b-f5ef-4e8e-811b-b40ff08bd385 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:15.420570 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f6ab5f2b-f5ef-4e8e-811b-b40ff08bd385 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.182971 Jun 27 21:19:15.421231 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 214/440] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:15 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:16.288750 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-eb6621b9-114e-4654-aefd-d7c56e14d8a1 req-b26f5a44-5520-4f1f-bae9-62da4b5d7219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b28fb7f-5684-4656-bd7c-b6d7d15790b1", "name": "network-vif-plugged", "status": "completed", "tag": "c722f6d7-3bed-4343-ad5e-1c84bfc3ac4e"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:16.297958 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-eb6621b9-114e-4654-aefd-d7c56e14d8a1 req-b26f5a44-5520-4f1f-bae9-62da4b5d7219 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:16.298586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-eb6621b9-114e-4654-aefd-d7c56e14d8a1 req-b26f5a44-5520-4f1f-bae9-62da4b5d7219 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:16.311201 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-eb6621b9-114e-4654-aefd-d7c56e14d8a1 req-b26f5a44-5520-4f1f-bae9-62da4b5d7219 service nova] Creating event network-vif-plugged:c722f6d7-3bed-4343-ad5e-1c84bfc3ac4e for instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 on hv-cinder-84773 Jun 27 21:19:16.316395 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-eb6621b9-114e-4654-aefd-d7c56e14d8a1 req-b26f5a44-5520-4f1f-bae9-62da4b5d7219 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031343 Jun 27 21:19:16.317810 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 227/441] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:16.440854 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-edaf37e7-de44-460b-bf57-0c29f374a715 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:16.441636 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-edaf37e7-de44-460b-bf57-0c29f374a715 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:16.449963 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-edaf37e7-de44-460b-bf57-0c29f374a715 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:16.450389 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-edaf37e7-de44-460b-bf57-0c29f374a715 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:16.451191 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-edaf37e7-de44-460b-bf57-0c29f374a715 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:16.451620 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-edaf37e7-de44-460b-bf57-0c29f374a715 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:16.593358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-edaf37e7-de44-460b-bf57-0c29f374a715 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:16.602835 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-edaf37e7-de44-460b-bf57-0c29f374a715 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:16.604355 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-edaf37e7-de44-460b-bf57-0c29f374a715 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:16.605559 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-edaf37e7-de44-460b-bf57-0c29f374a715 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.169034 Jun 27 21:19:16.606093 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 215/442] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:16 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:17.625650 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-83633e70-fa3c-47a0-b7c0-936dd5b8c65d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:17.626225 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-83633e70-fa3c-47a0-b7c0-936dd5b8c65d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:17.633033 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-83633e70-fa3c-47a0-b7c0-936dd5b8c65d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:17.633583 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-83633e70-fa3c-47a0-b7c0-936dd5b8c65d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:17.634345 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-83633e70-fa3c-47a0-b7c0-936dd5b8c65d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:17.634779 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-83633e70-fa3c-47a0-b7c0-936dd5b8c65d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:17.777123 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-83633e70-fa3c-47a0-b7c0-936dd5b8c65d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:17.786505 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-83633e70-fa3c-47a0-b7c0-936dd5b8c65d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:17.788009 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-83633e70-fa3c-47a0-b7c0-936dd5b8c65d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:17.789246 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-83633e70-fa3c-47a0-b7c0-936dd5b8c65d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.168586 Jun 27 21:19:17.789855 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 228/443] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:17 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:18.808609 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f5ede985-8128-48e0-aa78-2eec08372fd8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:18.809747 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f5ede985-8128-48e0-aa78-2eec08372fd8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:18.812837 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=26 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:18.819878 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f5ede985-8128-48e0-aa78-2eec08372fd8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:18.820626 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f5ede985-8128-48e0-aa78-2eec08372fd8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:18.822592 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f5ede985-8128-48e0-aa78-2eec08372fd8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:18.823812 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f5ede985-8128-48e0-aa78-2eec08372fd8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:18.975158 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f5ede985-8128-48e0-aa78-2eec08372fd8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:18.987486 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f5ede985-8128-48e0-aa78-2eec08372fd8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:18.990147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f5ede985-8128-48e0-aa78-2eec08372fd8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:18.992358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f5ede985-8128-48e0-aa78-2eec08372fd8 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1807 microversion: 2.20 time: 0.188176 Jun 27 21:19:18.993806 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 216/444] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:18 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:19.054359 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7944d344-fb3b-4f90-afcf-ba4f8b4a1111 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:19.055209 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7944d344-fb3b-4f90-afcf-ba4f8b4a1111 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:19.064087 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7944d344-fb3b-4f90-afcf-ba4f8b4a1111 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:19.064531 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7944d344-fb3b-4f90-afcf-ba4f8b4a1111 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:19.065391 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7944d344-fb3b-4f90-afcf-ba4f8b4a1111 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:19.065818 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7944d344-fb3b-4f90-afcf-ba4f8b4a1111 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:19.208236 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-7944d344-fb3b-4f90-afcf-ba4f8b4a1111 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lazy-loading 'services' on Instance uuid 977f8cd5-d96e-4a13-b043-405e5c4325f1 {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:19:19.348690 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7944d344-fb3b-4f90-afcf-ba4f8b4a1111 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "DELETE /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1/os-volume_attachments/a1c6fe0c-b9c4-4e54-b483-2b2d2fe7f388" status: 202 len: 0 microversion: 2.1 time: 0.298946 Jun 27 21:19:19.349849 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 229/445] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 27 21:19:19 2022] DELETE /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1/os-volume_attachments/a1c6fe0c-b9c4-4e54-b483-2b2d2fe7f388 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:19:20.015511 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6b71238d-f191-4644-9ebd-6c450a7009c3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:20.016813 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6b71238d-f191-4644-9ebd-6c450a7009c3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:20.026256 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6b71238d-f191-4644-9ebd-6c450a7009c3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:20.027123 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6b71238d-f191-4644-9ebd-6c450a7009c3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:20.027916 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6b71238d-f191-4644-9ebd-6c450a7009c3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:20.028346 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6b71238d-f191-4644-9ebd-6c450a7009c3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:20.170211 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6b71238d-f191-4644-9ebd-6c450a7009c3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:20.179182 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6b71238d-f191-4644-9ebd-6c450a7009c3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:20.181029 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6b71238d-f191-4644-9ebd-6c450a7009c3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:20.182246 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6b71238d-f191-4644-9ebd-6c450a7009c3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1794 microversion: 2.20 time: 0.170827 Jun 27 21:19:20.182858 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 217/446] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:20 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1794 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:19:20.395192 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a75502e4-3233-4d24-aede-4f70734ce2e6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:20.396189 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a75502e4-3233-4d24-aede-4f70734ce2e6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:20.403957 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a75502e4-3233-4d24-aede-4f70734ce2e6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:20.404386 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a75502e4-3233-4d24-aede-4f70734ce2e6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:20.405197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a75502e4-3233-4d24-aede-4f70734ce2e6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:20.405621 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a75502e4-3233-4d24-aede-4f70734ce2e6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:20.431451 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-a75502e4-3233-4d24-aede-4f70734ce2e6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lazy-loading 'flavor' on Instance uuid 3a1409c2-ecfa-4ed4-b547-aa5667367e5d {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:19:20.592774 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a75502e4-3233-4d24-aede-4f70734ce2e6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "POST /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d/action" status: 200 len: 32 microversion: 2.1 time: 0.202030 Jun 27 21:19:20.593631 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 230/447] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 27 21:19:20 2022] POST /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d/action => generated 32 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 21:19:20.603386 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1adfe856-38d3-461c-8dbd-2b3711fe0bb6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:20.604022 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1adfe856-38d3-461c-8dbd-2b3711fe0bb6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:20.610461 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1adfe856-38d3-461c-8dbd-2b3711fe0bb6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:20.610902 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1adfe856-38d3-461c-8dbd-2b3711fe0bb6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:20.611658 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1adfe856-38d3-461c-8dbd-2b3711fe0bb6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:20.612078 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1adfe856-38d3-461c-8dbd-2b3711fe0bb6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:20.771059 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d446935e-b198-4338-a0ea-94bd2ad5e9f8 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:20.771880 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d446935e-b198-4338-a0ea-94bd2ad5e9f8 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:20.780118 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d446935e-b198-4338-a0ea-94bd2ad5e9f8 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:20.780879 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d446935e-b198-4338-a0ea-94bd2ad5e9f8 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:20.782049 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d446935e-b198-4338-a0ea-94bd2ad5e9f8 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:20.782586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d446935e-b198-4338-a0ea-94bd2ad5e9f8 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:20.796899 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1adfe856-38d3-461c-8dbd-2b3711fe0bb6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:20.806399 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1adfe856-38d3-461c-8dbd-2b3711fe0bb6 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1735 microversion: 2.1 time: 0.207612 Jun 27 21:19:20.806997 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 218/448] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:20 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1735 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:20.823097 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d446935e-b198-4338-a0ea-94bd2ad5e9f8 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2/ips" status: 200 len: 149 microversion: 2.1 time: 0.057359 Jun 27 21:19:20.823952 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 231/449] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 27 21:19:20 2022] GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2/ips => generated 149 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:19:20.839164 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ddef2301-1bda-457c-8532-899504b5015e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d382b32-bdd0-44eb-a043-184d9e87e72d"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:20.841290 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ddef2301-1bda-457c-8532-899504b5015e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:20.851300 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ddef2301-1bda-457c-8532-899504b5015e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:20.852129 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ddef2301-1bda-457c-8532-899504b5015e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:20.853636 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ddef2301-1bda-457c-8532-899504b5015e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:20.854719 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ddef2301-1bda-457c-8532-899504b5015e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:20.959180 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-ddef2301-1bda-457c-8532-899504b5015e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] HTTP exception thrown: Invalid volume: volume 7d382b32-bdd0-44eb-a043-184d9e87e72d is already attached to instances: b2a76ab5-ca81-472e-8d89-69e63b684ae3 Jun 27 21:19:20.961932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ddef2301-1bda-457c-8532-899504b5015e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Request method failure captured: Jun 27 21:19:20.961932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: POST /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2/os-volume_attachments HTTP/1.1 Jun 27 21:19:20.961932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:19:20.961932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:19:20.961932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:19:20.961932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 74 Jun 27 21:19:20.961932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:19:20.961932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:19:20.961932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:19:20.961932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:19:20.961932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh4YqTj0KDKiAA8-Ybj3-gdHviC0IY0gRPX_-zc843y94FxFezSOatXJ1qtJsvtWNZXTTXRx1zonPA_7MuDBpdKOf2Im45jkxvzu24Ha4gAYEuaWcvZ6e6-OgMyPsQ6l_aEAmdX7x7dpM8AjaVFtaQBsb85u09RPN7A4hzw049NiIF4 Jun 27 21:19:20.961932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:19:20.961932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:19:20.961932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:19:20.961932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:19:20.961932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:19:20.961932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:19:20.961932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:19:20.961932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:19:20.961932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:19:20.961932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:19:20.963509 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a74724882c84e8f893f5be0f59a9581", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}] Jun 27 21:19:20.963509 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:19:20.963509 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:19:20.963509 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:19:20.963509 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:19:20.963509 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:19:20.963509 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:19:20.963509 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: fff9f1fc84a54b83a7a384965f40c9d9 Jun 27 21:19:20.963509 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:19:20.963509 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Jun 27 21:19:20.963509 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {"volumeAttachment": {"volumeId": "7d382b32-bdd0-44eb-a043-184d9e87e72d"}} Jun 27 21:19:20.963509 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:19:20.964268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Invalid volume: volume 7d382b32-bdd0-44eb-a043-184d9e87e72d is already attached to instances: b2a76ab5-ca81-472e-8d89-69e63b684ae3 Jun 27 21:19:20.964268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'server_id': '3c5b1522-b5e3-4328-9292-5f99591179a2', 'body': {'volumeAttachment': {'volumeId': '7d382b32-bdd0-44eb-a043-184d9e87e72d'}}} Jun 27 21:19:20.964268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:19:20.964268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:20.964268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 27 21:19:20.964268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 27 21:19:20.964268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 21:19:20.964268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 21:19:20.964268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 27 21:19:20.964268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 27 21:19:20.964268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 27 21:19:20.964268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 27 21:19:20.964268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 27 21:19:20.964268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 27 21:19:20.964268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7d382b32-bdd0-44eb-a043-184d9e87e72d is already attached to instances: b2a76ab5-ca81-472e-8d89-69e63b684ae3 Jun 27 21:19:20.964268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:19:20.964268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:19:20.964268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:19:20.964268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:20.965505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:19:20.965505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:19:20.965505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:19:20.965505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:19:20.965505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:19:20.965505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:19:20.965505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 21:19:20.965505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 21:19:20.965505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 21:19:20.965505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 21:19:20.965505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 21:19:20.965505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 21:19:20.965505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 27 21:19:20.965505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 27 21:19:20.965505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7d382b32-bdd0-44eb-a043-184d9e87e72d is already attached to instances: b2a76ab5-ca81-472e-8d89-69e63b684ae3 Jun 27 21:19:20.965505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:19:20.965505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:19:20.965505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:19:20.965505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:20.965505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:19:20.966645 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:19:20.966645 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:19:20.966645 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:19:20.966645 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7d382b32-bdd0-44eb-a043-184d9e87e72d is already attached to instances: b2a76ab5-ca81-472e-8d89-69e63b684ae3 Jun 27 21:19:20.966645 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:19:20.966645 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ddef2301-1bda-457c-8532-899504b5015e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Returning 400 to user: Invalid volume: volume 7d382b32-bdd0-44eb-a043-184d9e87e72d is already attached to instances: b2a76ab5-ca81-472e-8d89-69e63b684ae3 {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:19:20.966645 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ddef2301-1bda-457c-8532-899504b5015e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "POST /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.132420 Jun 27 21:19:20.966645 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 219/450] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 27 21:19:20 2022] POST /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2/os-volume_attachments => generated 174 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 27 21:19:20.972598 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3c41f5ce-cae0-4d30-9ea0-583b0dab3577 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:20.973128 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3c41f5ce-cae0-4d30-9ea0-583b0dab3577 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:20.979741 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3c41f5ce-cae0-4d30-9ea0-583b0dab3577 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:20.980186 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3c41f5ce-cae0-4d30-9ea0-583b0dab3577 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:20.980994 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3c41f5ce-cae0-4d30-9ea0-583b0dab3577 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:20.981484 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3c41f5ce-cae0-4d30-9ea0-583b0dab3577 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:21.006841 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3c41f5ce-cae0-4d30-9ea0-583b0dab3577 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Going to try to terminate instance {{(pid=117891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:19:21.105456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3c41f5ce-cae0-4d30-9ea0-583b0dab3577 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2" status: 204 len: 0 microversion: 2.1 time: 0.136364 Jun 27 21:19:21.110395 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 232/451] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:19:20 2022] DELETE /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:19:21.117558 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8acc40fd-0c1f-4fde-9a53-e38e514d75fb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:21.118500 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8acc40fd-0c1f-4fde-9a53-e38e514d75fb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:21.127780 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8acc40fd-0c1f-4fde-9a53-e38e514d75fb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:21.128214 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8acc40fd-0c1f-4fde-9a53-e38e514d75fb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:21.129016 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8acc40fd-0c1f-4fde-9a53-e38e514d75fb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:21.129447 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8acc40fd-0c1f-4fde-9a53-e38e514d75fb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:21.275542 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8acc40fd-0c1f-4fde-9a53-e38e514d75fb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:21.283594 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8acc40fd-0c1f-4fde-9a53-e38e514d75fb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2" status: 200 len: 1681 microversion: 2.1 time: 0.171497 Jun 27 21:19:21.284182 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 220/452] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:21 2022] GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:21.554030 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-172409ca-0c48-49e1-b00e-fa634170c577 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:21.561288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-172409ca-0c48-49e1-b00e-fa634170c577 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:21.561731 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-172409ca-0c48-49e1-b00e-fa634170c577 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:21.584005 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-172409ca-0c48-49e1-b00e-fa634170c577 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Going to try to stop instance {{(pid=117891) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 27 21:19:21.627595 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-172409ca-0c48-49e1-b00e-fa634170c577 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "POST /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1/action" status: 202 len: 0 microversion: 2.1 time: 0.077730 Jun 27 21:19:21.628334 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 233/453] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 27 21:19:21 2022] POST /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:19:21.636753 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c9ce1858-361d-4e9c-9f2f-a35838b66778 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:21.637407 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c9ce1858-361d-4e9c-9f2f-a35838b66778 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:21.643649 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c9ce1858-361d-4e9c-9f2f-a35838b66778 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:21.644106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c9ce1858-361d-4e9c-9f2f-a35838b66778 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:21.644873 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c9ce1858-361d-4e9c-9f2f-a35838b66778 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:21.645326 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c9ce1858-361d-4e9c-9f2f-a35838b66778 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:21.776720 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c9ce1858-361d-4e9c-9f2f-a35838b66778 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:21.785280 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c9ce1858-361d-4e9c-9f2f-a35838b66778 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1724 microversion: 2.1 time: 0.152479 Jun 27 21:19:21.785845 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 221/454] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:21 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:21.824670 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-cd418513-baf7-40bd-9b7f-ce7009226fda tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:21.825393 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-cd418513-baf7-40bd-9b7f-ce7009226fda tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:21.832127 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cd418513-baf7-40bd-9b7f-ce7009226fda tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:21.832603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cd418513-baf7-40bd-9b7f-ce7009226fda tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:21.833423 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cd418513-baf7-40bd-9b7f-ce7009226fda tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:21.833854 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cd418513-baf7-40bd-9b7f-ce7009226fda tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:21.849553 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:21.974343 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-cd418513-baf7-40bd-9b7f-ce7009226fda tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:21.983100 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-cd418513-baf7-40bd-9b7f-ce7009226fda tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1735 microversion: 2.1 time: 0.163208 Jun 27 21:19:21.983682 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 234/455] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:21 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:22.302443 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-052c7d86-5dbf-4400-86b4-c8239749a879 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:22.303156 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-052c7d86-5dbf-4400-86b4-c8239749a879 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:22.310151 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-052c7d86-5dbf-4400-86b4-c8239749a879 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:22.310572 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-052c7d86-5dbf-4400-86b4-c8239749a879 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:22.311364 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-052c7d86-5dbf-4400-86b4-c8239749a879 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:22.311787 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-052c7d86-5dbf-4400-86b4-c8239749a879 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:22.454359 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-052c7d86-5dbf-4400-86b4-c8239749a879 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:22.462529 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-052c7d86-5dbf-4400-86b4-c8239749a879 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2" status: 200 len: 1681 microversion: 2.1 time: 0.164057 Jun 27 21:19:22.463118 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 222/456] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:22 2022] GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:22.803137 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5029fefa-5ed6-4c37-9a8d-c6574a426f29 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:22.804071 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-5029fefa-5ed6-4c37-9a8d-c6574a426f29 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:22.811674 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5029fefa-5ed6-4c37-9a8d-c6574a426f29 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:22.812120 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5029fefa-5ed6-4c37-9a8d-c6574a426f29 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:22.812865 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5029fefa-5ed6-4c37-9a8d-c6574a426f29 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:22.813324 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5029fefa-5ed6-4c37-9a8d-c6574a426f29 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:22.947201 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5029fefa-5ed6-4c37-9a8d-c6574a426f29 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:22.955023 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5029fefa-5ed6-4c37-9a8d-c6574a426f29 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1678 microversion: 2.1 time: 0.155729 Jun 27 21:19:22.955602 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 235/457] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:22 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:22.999588 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a669639a-45e5-4510-946b-b81fe17fe715 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:23.000465 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a669639a-45e5-4510-946b-b81fe17fe715 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:23.006840 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a669639a-45e5-4510-946b-b81fe17fe715 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:23.007282 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a669639a-45e5-4510-946b-b81fe17fe715 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:23.008264 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a669639a-45e5-4510-946b-b81fe17fe715 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:23.008815 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a669639a-45e5-4510-946b-b81fe17fe715 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:23.144748 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a669639a-45e5-4510-946b-b81fe17fe715 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:23.153201 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a669639a-45e5-4510-946b-b81fe17fe715 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1735 microversion: 2.1 time: 0.157394 Jun 27 21:19:23.153780 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 223/458] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:22 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:23.480664 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-34115680-d9e0-4745-9996-3eb4a59cee94 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:23.481307 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-34115680-d9e0-4745-9996-3eb4a59cee94 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:23.487806 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-34115680-d9e0-4745-9996-3eb4a59cee94 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:23.488246 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-34115680-d9e0-4745-9996-3eb4a59cee94 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:23.489037 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-34115680-d9e0-4745-9996-3eb4a59cee94 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:23.489456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-34115680-d9e0-4745-9996-3eb4a59cee94 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:23.627478 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-34115680-d9e0-4745-9996-3eb4a59cee94 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:23.635720 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-34115680-d9e0-4745-9996-3eb4a59cee94 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2" status: 200 len: 1681 microversion: 2.1 time: 0.159540 Jun 27 21:19:23.636296 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 236/459] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:23 2022] GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:23.972941 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-128ddec2-821c-4ff3-b750-64092e66d2ba tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:23.973794 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-128ddec2-821c-4ff3-b750-64092e66d2ba tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:23.981427 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-128ddec2-821c-4ff3-b750-64092e66d2ba tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:23.982001 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-128ddec2-821c-4ff3-b750-64092e66d2ba tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:23.982871 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-128ddec2-821c-4ff3-b750-64092e66d2ba tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:23.983374 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-128ddec2-821c-4ff3-b750-64092e66d2ba tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:24.170742 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c463ee6d-6b7c-4aa0-af56-c7c256088d42 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:24.171525 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c463ee6d-6b7c-4aa0-af56-c7c256088d42 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:24.182888 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c463ee6d-6b7c-4aa0-af56-c7c256088d42 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:24.183606 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c463ee6d-6b7c-4aa0-af56-c7c256088d42 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:24.184619 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c463ee6d-6b7c-4aa0-af56-c7c256088d42 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:24.185309 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c463ee6d-6b7c-4aa0-af56-c7c256088d42 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:24.231028 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-128ddec2-821c-4ff3-b750-64092e66d2ba tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:24.249862 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-128ddec2-821c-4ff3-b750-64092e66d2ba tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1678 microversion: 2.1 time: 0.280957 Jun 27 21:19:24.251404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 224/460] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:23 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1678 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:24.271996 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-454b69d1-1623-4f8f-bab2-83eda892f4a5 req-24e9d63a-0e28-482a-bb5d-becdbef740d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c5b1522-b5e3-4328-9292-5f99591179a2", "name": "network-vif-deleted", "tag": "63757cf8-adc3-4cb5-8c67-986e0c574946"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:24.281529 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-454b69d1-1623-4f8f-bab2-83eda892f4a5 req-24e9d63a-0e28-482a-bb5d-becdbef740d4 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:24.281969 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-454b69d1-1623-4f8f-bab2-83eda892f4a5 req-24e9d63a-0e28-482a-bb5d-becdbef740d4 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:24.324025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-454b69d1-1623-4f8f-bab2-83eda892f4a5 req-24e9d63a-0e28-482a-bb5d-becdbef740d4 service nova] Creating event network-vif-deleted:63757cf8-adc3-4cb5-8c67-986e0c574946 for instance 3c5b1522-b5e3-4328-9292-5f99591179a2 on hv-cinder-84773 Jun 27 21:19:24.334298 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-454b69d1-1623-4f8f-bab2-83eda892f4a5 req-24e9d63a-0e28-482a-bb5d-becdbef740d4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079152 Jun 27 21:19:24.335314 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 225/461] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:24.380917 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c463ee6d-6b7c-4aa0-af56-c7c256088d42 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:24.389893 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c463ee6d-6b7c-4aa0-af56-c7c256088d42 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1735 microversion: 2.1 time: 0.222939 Jun 27 21:19:24.390487 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 237/462] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:24 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:24.653610 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-33aca250-495a-432b-81db-42401a52bc84 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:24.654326 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-33aca250-495a-432b-81db-42401a52bc84 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:24.671816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33aca250-495a-432b-81db-42401a52bc84 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:24.673981 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33aca250-495a-432b-81db-42401a52bc84 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:24.675069 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33aca250-495a-432b-81db-42401a52bc84 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:24.675710 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33aca250-495a-432b-81db-42401a52bc84 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:24.722460 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33aca250-495a-432b-81db-42401a52bc84 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:24.723596 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33aca250-495a-432b-81db-42401a52bc84 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:24.724362 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-33aca250-495a-432b-81db-42401a52bc84 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lazy-loading 'fault' on Instance uuid 3c5b1522-b5e3-4328-9292-5f99591179a2 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:19:24.788496 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-33aca250-495a-432b-81db-42401a52bc84 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:24.799111 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-33aca250-495a-432b-81db-42401a52bc84 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2" status: 200 len: 1331 microversion: 2.1 time: 0.150387 Jun 27 21:19:24.800985 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 226/463] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:24 2022] GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 => generated 1331 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:25.269216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a748a7d8-acdd-4fac-a770-9cf5ea0deb61 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:25.269818 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a748a7d8-acdd-4fac-a770-9cf5ea0deb61 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:25.279564 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a748a7d8-acdd-4fac-a770-9cf5ea0deb61 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:25.280296 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a748a7d8-acdd-4fac-a770-9cf5ea0deb61 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:25.281306 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a748a7d8-acdd-4fac-a770-9cf5ea0deb61 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:25.281900 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a748a7d8-acdd-4fac-a770-9cf5ea0deb61 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:25.410630 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ef4c13c2-5832-4de0-8412-1797ce32ce30 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:25.412121 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ef4c13c2-5832-4de0-8412-1797ce32ce30 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:25.421685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef4c13c2-5832-4de0-8412-1797ce32ce30 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:25.422513 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef4c13c2-5832-4de0-8412-1797ce32ce30 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:25.423458 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef4c13c2-5832-4de0-8412-1797ce32ce30 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:25.423901 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef4c13c2-5832-4de0-8412-1797ce32ce30 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:25.451422 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a748a7d8-acdd-4fac-a770-9cf5ea0deb61 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:25.459787 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a748a7d8-acdd-4fac-a770-9cf5ea0deb61 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1678 microversion: 2.1 time: 0.195848 Jun 27 21:19:25.461072 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 238/464] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:25 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1678 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:25.631057 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ef4c13c2-5832-4de0-8412-1797ce32ce30 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:25.636086 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:25.642431 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ef4c13c2-5832-4de0-8412-1797ce32ce30 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1735 microversion: 2.1 time: 0.238522 Jun 27 21:19:25.643409 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 227/465] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:25 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1735 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:25.819688 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-df765645-f6aa-4a52-bc43-771acb61026b tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:25.820342 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-df765645-f6aa-4a52-bc43-771acb61026b tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:25.828143 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-df765645-f6aa-4a52-bc43-771acb61026b tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:25.828850 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-df765645-f6aa-4a52-bc43-771acb61026b tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:25.830057 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-df765645-f6aa-4a52-bc43-771acb61026b tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:25.830497 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-df765645-f6aa-4a52-bc43-771acb61026b tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:25.858961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-df765645-f6aa-4a52-bc43-771acb61026b tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] HTTP exception thrown: Instance 3c5b1522-b5e3-4328-9292-5f99591179a2 could not be found. Jun 27 21:19:25.858961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-df765645-f6aa-4a52-bc43-771acb61026b tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Request method failure captured: Jun 27 21:19:25.858961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 HTTP/1.1 Jun 27 21:19:25.858961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:19:25.858961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:19:25.858961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:19:25.858961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:19:25.858961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:19:25.858961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:19:25.858961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:19:25.858961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:19:25.858961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh4YqTj0KDKiAA8-Ybj3-gdHviC0IY0gRPX_-zc843y94FxFezSOatXJ1qtJsvtWNZXTTXRx1zonPA_7MuDBpdKOf2Im45jkxvzu24Ha4gAYEuaWcvZ6e6-OgMyPsQ6l_aEAmdX7x7dpM8AjaVFtaQBsb85u09RPN7A4hzw049NiIF4 Jun 27 21:19:25.858961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:19:25.858961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:19:25.858961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:19:25.858961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:19:25.858961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:19:25.858961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:19:25.858961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:19:25.858961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:19:25.858961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:19:25.858961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:19:25.861891 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a74724882c84e8f893f5be0f59a9581", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}] Jun 27 21:19:25.861891 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:19:25.861891 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:19:25.861891 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:19:25.861891 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:19:25.861891 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:19:25.861891 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:19:25.861891 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: fff9f1fc84a54b83a7a384965f40c9d9 Jun 27 21:19:25.861891 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:19:25.861891 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: > Jun 27 21:19:25.861891 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Instance 3c5b1522-b5e3-4328-9292-5f99591179a2 could not be found. Jun 27 21:19:25.861891 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'id': '3c5b1522-b5e3-4328-9292-5f99591179a2'} Jun 27 21:19:25.862901 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:19:25.862901 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:25.862901 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:19:25.862901 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:19:25.862901 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:19:25.862901 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:19:25.862901 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:19:25.862901 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:19:25.862901 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:19:25.862901 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:19:25.862901 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c5b1522-b5e3-4328-9292-5f99591179a2 could not be found. Jun 27 21:19:25.862901 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:19:25.862901 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:19:25.862901 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:19:25.862901 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:25.862901 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:19:25.862901 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:19:25.862901 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:19:25.862901 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:19:25.862901 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:19:25.864800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:19:25.864800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:19:25.864800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:19:25.864800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:19:25.864800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:19:25.864800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:19:25.864800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:19:25.864800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c5b1522-b5e3-4328-9292-5f99591179a2 could not be found. Jun 27 21:19:25.864800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:19:25.864800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:19:25.864800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:19:25.864800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:25.864800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:19:25.864800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:19:25.864800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:19:25.864800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:19:25.864800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c5b1522-b5e3-4328-9292-5f99591179a2 could not be found. Jun 27 21:19:25.864800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:19:25.866368 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-df765645-f6aa-4a52-bc43-771acb61026b tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Returning 404 to user: Instance 3c5b1522-b5e3-4328-9292-5f99591179a2 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:19:25.866368 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-df765645-f6aa-4a52-bc43-771acb61026b tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2" status: 404 len: 111 microversion: 2.1 time: 0.040198 Jun 27 21:19:25.866368 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 239/466] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:25 2022] GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:19:25.873850 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0919e014-bcce-44e4-bb5b-0ea10e6d7325 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '.version_select at 0x7f83543bd430>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:25.901103 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0919e014-bcce-44e4-bb5b-0ea10e6d7325 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-863592044" status: 202 len: 0 microversion: 2.1 time: 0.034523 Jun 27 21:19:25.901103 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 228/467] 10.222.0.13 () {58 vars in 1217 bytes} [Mon Jun 27 21:19:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-863592044 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 21:19:26.478363 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f20fd5b6-2975-41df-aa6d-aaf4560d4208 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:26.478987 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f20fd5b6-2975-41df-aa6d-aaf4560d4208 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:26.485760 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f20fd5b6-2975-41df-aa6d-aaf4560d4208 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:26.486210 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f20fd5b6-2975-41df-aa6d-aaf4560d4208 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:26.486986 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f20fd5b6-2975-41df-aa6d-aaf4560d4208 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:26.487556 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f20fd5b6-2975-41df-aa6d-aaf4560d4208 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:26.609246 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f2be2234-4642-4f91-87c8-e5b87f1884a2 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:26.609815 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f2be2234-4642-4f91-87c8-e5b87f1884a2 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:26.616488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f2be2234-4642-4f91-87c8-e5b87f1884a2 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:26.616959 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f2be2234-4642-4f91-87c8-e5b87f1884a2 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:26.617928 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f2be2234-4642-4f91-87c8-e5b87f1884a2 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:26.618360 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f2be2234-4642-4f91-87c8-e5b87f1884a2 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:26.629341 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f20fd5b6-2975-41df-aa6d-aaf4560d4208 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:26.637268 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f20fd5b6-2975-41df-aa6d-aaf4560d4208 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1678 microversion: 2.1 time: 0.163473 Jun 27 21:19:26.637925 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 240/468] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:26 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:26.659767 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c9c7412d-1263-4a41-9332-f87f59e41de0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:26.660505 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c9c7412d-1263-4a41-9332-f87f59e41de0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:26.667396 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c9c7412d-1263-4a41-9332-f87f59e41de0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:26.667967 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c9c7412d-1263-4a41-9332-f87f59e41de0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:26.668817 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c9c7412d-1263-4a41-9332-f87f59e41de0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:26.669350 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c9c7412d-1263-4a41-9332-f87f59e41de0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:26.750777 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-f2be2234-4642-4f91-87c8-e5b87f1884a2 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lazy-loading 'services' on Instance uuid b2a76ab5-ca81-472e-8d89-69e63b684ae3 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:19:26.829286 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c9c7412d-1263-4a41-9332-f87f59e41de0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:26.843169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c9c7412d-1263-4a41-9332-f87f59e41de0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1735 microversion: 2.1 time: 0.187326 Jun 27 21:19:26.843809 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 241/469] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:26 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:26.879022 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f2be2234-4642-4f91-87c8-e5b87f1884a2 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3/os-volume_attachments/7d382b32-bdd0-44eb-a043-184d9e87e72d" status: 202 len: 0 microversion: 2.1 time: 0.274016 Jun 27 21:19:26.879678 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 229/470] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 27 21:19:26 2022] DELETE /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3/os-volume_attachments/7d382b32-bdd0-44eb-a043-184d9e87e72d => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:19:26.889100 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ba3e8f27-c970-48ef-ac6e-329d39abe13d tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:26.890098 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ba3e8f27-c970-48ef-ac6e-329d39abe13d tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:26.899513 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ba3e8f27-c970-48ef-ac6e-329d39abe13d tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:26.900270 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ba3e8f27-c970-48ef-ac6e-329d39abe13d tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:26.901713 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ba3e8f27-c970-48ef-ac6e-329d39abe13d tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:26.902544 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ba3e8f27-c970-48ef-ac6e-329d39abe13d tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:26.938009 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ba3e8f27-c970-48ef-ac6e-329d39abe13d tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052988 Jun 27 21:19:26.938632 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 242/471] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 27 21:19:26 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:27.656289 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f91d3e09-1509-4394-bab0-be1170cac28a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:27.656960 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f91d3e09-1509-4394-bab0-be1170cac28a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:27.663614 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f91d3e09-1509-4394-bab0-be1170cac28a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:27.664087 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f91d3e09-1509-4394-bab0-be1170cac28a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:27.664963 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f91d3e09-1509-4394-bab0-be1170cac28a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:27.665410 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f91d3e09-1509-4394-bab0-be1170cac28a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:27.808347 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f91d3e09-1509-4394-bab0-be1170cac28a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:27.816269 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f91d3e09-1509-4394-bab0-be1170cac28a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1678 microversion: 2.1 time: 0.164853 Jun 27 21:19:27.816854 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 230/472] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:27 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:27.860021 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d933b666-5318-4bcf-826e-3d467f584539 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:27.860834 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d933b666-5318-4bcf-826e-3d467f584539 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:27.868258 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d933b666-5318-4bcf-826e-3d467f584539 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:27.868700 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d933b666-5318-4bcf-826e-3d467f584539 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:27.869878 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d933b666-5318-4bcf-826e-3d467f584539 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:27.870029 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d933b666-5318-4bcf-826e-3d467f584539 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:27.952144 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5d45a207-64d0-4de4-bf38-adb307a37cda tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:27.953412 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5d45a207-64d0-4de4-bf38-adb307a37cda tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:27.960992 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d45a207-64d0-4de4-bf38-adb307a37cda tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:27.961584 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d45a207-64d0-4de4-bf38-adb307a37cda tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:27.962864 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d45a207-64d0-4de4-bf38-adb307a37cda tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:27.963285 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d45a207-64d0-4de4-bf38-adb307a37cda tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:28.000159 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5d45a207-64d0-4de4-bf38-adb307a37cda tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053775 Jun 27 21:19:28.000745 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 231/473] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 27 21:19:27 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 21:19:28.010403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d933b666-5318-4bcf-826e-3d467f584539 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:28.018760 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d933b666-5318-4bcf-826e-3d467f584539 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1735 microversion: 2.1 time: 0.162538 Jun 27 21:19:28.020168 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 243/474] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:27 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:28.062401 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0bdaa59b-4ee3-4905-9b38-c06bd286a2e7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:28.062899 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0bdaa59b-4ee3-4905-9b38-c06bd286a2e7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:28.069647 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0bdaa59b-4ee3-4905-9b38-c06bd286a2e7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:28.070096 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0bdaa59b-4ee3-4905-9b38-c06bd286a2e7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:28.070914 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0bdaa59b-4ee3-4905-9b38-c06bd286a2e7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:28.071363 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0bdaa59b-4ee3-4905-9b38-c06bd286a2e7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:28.096621 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0bdaa59b-4ee3-4905-9b38-c06bd286a2e7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:19:28.179055 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0bdaa59b-4ee3-4905-9b38-c06bd286a2e7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 204 len: 0 microversion: 2.1 time: 0.119505 Jun 27 21:19:28.180365 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 232/475] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:19:28 2022] DELETE /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:19:28.193095 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d19ce189-5848-4b48-a1fd-54483bf7905d tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:28.194897 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d19ce189-5848-4b48-a1fd-54483bf7905d tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:28.206492 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d19ce189-5848-4b48-a1fd-54483bf7905d tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:28.207157 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d19ce189-5848-4b48-a1fd-54483bf7905d tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:28.208452 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d19ce189-5848-4b48-a1fd-54483bf7905d tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:28.209081 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d19ce189-5848-4b48-a1fd-54483bf7905d tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:28.355893 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d19ce189-5848-4b48-a1fd-54483bf7905d tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:28.364960 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d19ce189-5848-4b48-a1fd-54483bf7905d tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1680 microversion: 2.1 time: 0.179307 Jun 27 21:19:28.365823 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 244/476] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:28 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:28.838003 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-feaf0630-b242-4909-9cc5-b7f2e5413e67 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:28.838639 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-feaf0630-b242-4909-9cc5-b7f2e5413e67 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:28.846212 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-feaf0630-b242-4909-9cc5-b7f2e5413e67 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:28.846677 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-feaf0630-b242-4909-9cc5-b7f2e5413e67 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:28.847455 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-feaf0630-b242-4909-9cc5-b7f2e5413e67 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:28.847888 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-feaf0630-b242-4909-9cc5-b7f2e5413e67 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:28.986145 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-feaf0630-b242-4909-9cc5-b7f2e5413e67 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:28.994360 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-feaf0630-b242-4909-9cc5-b7f2e5413e67 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1678 microversion: 2.1 time: 0.161883 Jun 27 21:19:28.994950 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 233/477] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:28 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:29.037475 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-84e06bc1-97f8-4076-ad57-b66761e7df72 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:29.038106 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-84e06bc1-97f8-4076-ad57-b66761e7df72 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:29.045122 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-84e06bc1-97f8-4076-ad57-b66761e7df72 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:29.045552 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-84e06bc1-97f8-4076-ad57-b66761e7df72 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:29.046336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-84e06bc1-97f8-4076-ad57-b66761e7df72 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:29.046749 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-84e06bc1-97f8-4076-ad57-b66761e7df72 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:29.182564 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-84e06bc1-97f8-4076-ad57-b66761e7df72 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:29.190912 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-84e06bc1-97f8-4076-ad57-b66761e7df72 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1735 microversion: 2.1 time: 0.157335 Jun 27 21:19:29.191468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 245/478] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:29 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:29.383134 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f9614755-4d68-4e43-b20c-713e7e56deed tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:29.383773 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f9614755-4d68-4e43-b20c-713e7e56deed tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:29.390523 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f9614755-4d68-4e43-b20c-713e7e56deed tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:29.390981 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f9614755-4d68-4e43-b20c-713e7e56deed tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:29.391753 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f9614755-4d68-4e43-b20c-713e7e56deed tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:29.392188 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f9614755-4d68-4e43-b20c-713e7e56deed tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:29.526801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f9614755-4d68-4e43-b20c-713e7e56deed tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:29.534747 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f9614755-4d68-4e43-b20c-713e7e56deed tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1680 microversion: 2.1 time: 0.155843 Jun 27 21:19:29.535370 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 234/479] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:29 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:30.012569 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-bd2b815c-d881-4410-b206-134a0b411055 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:30.013214 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-bd2b815c-d881-4410-b206-134a0b411055 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:30.015290 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:30.020940 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bd2b815c-d881-4410-b206-134a0b411055 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:30.021420 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bd2b815c-d881-4410-b206-134a0b411055 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:30.022207 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bd2b815c-d881-4410-b206-134a0b411055 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:30.022640 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bd2b815c-d881-4410-b206-134a0b411055 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:30.157411 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-bd2b815c-d881-4410-b206-134a0b411055 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:30.165603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-bd2b815c-d881-4410-b206-134a0b411055 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1678 microversion: 2.1 time: 0.157177 Jun 27 21:19:30.166166 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 246/480] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:30 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:30.208267 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0e88f44b-061c-4521-b07d-3c7a3e82f719 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:30.208916 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0e88f44b-061c-4521-b07d-3c7a3e82f719 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:30.216392 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e88f44b-061c-4521-b07d-3c7a3e82f719 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:30.216827 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e88f44b-061c-4521-b07d-3c7a3e82f719 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:30.217694 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e88f44b-061c-4521-b07d-3c7a3e82f719 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:30.218251 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e88f44b-061c-4521-b07d-3c7a3e82f719 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:30.553059 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-26170cae-89ee-4c59-81a0-e3c1ae335e32 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:30.553594 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-26170cae-89ee-4c59-81a0-e3c1ae335e32 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:30.561515 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-26170cae-89ee-4c59-81a0-e3c1ae335e32 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:30.561986 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-26170cae-89ee-4c59-81a0-e3c1ae335e32 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:30.562756 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-26170cae-89ee-4c59-81a0-e3c1ae335e32 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:30.563188 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-26170cae-89ee-4c59-81a0-e3c1ae335e32 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:30.692961 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0e88f44b-061c-4521-b07d-3c7a3e82f719 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:30.703350 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0e88f44b-061c-4521-b07d-3c7a3e82f719 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1735 microversion: 2.1 time: 0.498733 Jun 27 21:19:30.703656 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 235/481] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:30 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1735 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:30.708697 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-26170cae-89ee-4c59-81a0-e3c1ae335e32 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:30.719709 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-26170cae-89ee-4c59-81a0-e3c1ae335e32 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1680 microversion: 2.1 time: 0.171033 Jun 27 21:19:30.720291 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 247/482] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:30 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:31.184358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cd912a8d-5a12-487e-927f-673cbae5d385 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:31.185158 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cd912a8d-5a12-487e-927f-673cbae5d385 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:31.192308 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cd912a8d-5a12-487e-927f-673cbae5d385 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:31.192876 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cd912a8d-5a12-487e-927f-673cbae5d385 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:31.193885 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cd912a8d-5a12-487e-927f-673cbae5d385 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:31.194384 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cd912a8d-5a12-487e-927f-673cbae5d385 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:31.423721 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cd912a8d-5a12-487e-927f-673cbae5d385 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:31.432803 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cd912a8d-5a12-487e-927f-673cbae5d385 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1678 microversion: 2.1 time: 0.252809 Jun 27 21:19:31.433460 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 236/483] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:31 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1678 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:31.544274 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-df84c8f6-b6d2-4122-90ca-bcaced60f4a2 req-2182b1af-ca6f-4448-8113-e956c0b28618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a76ab5-ca81-472e-8d89-69e63b684ae3", "name": "network-vif-deleted", "tag": "6de54808-7215-48a3-8344-ee5680120151"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:31.554295 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-df84c8f6-b6d2-4122-90ca-bcaced60f4a2 req-2182b1af-ca6f-4448-8113-e956c0b28618 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:31.555095 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-df84c8f6-b6d2-4122-90ca-bcaced60f4a2 req-2182b1af-ca6f-4448-8113-e956c0b28618 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:31.570836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-df84c8f6-b6d2-4122-90ca-bcaced60f4a2 req-2182b1af-ca6f-4448-8113-e956c0b28618 service nova] Creating event network-vif-deleted:6de54808-7215-48a3-8344-ee5680120151 for instance b2a76ab5-ca81-472e-8d89-69e63b684ae3 on hv-cinder-84773 Jun 27 21:19:31.576443 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-df84c8f6-b6d2-4122-90ca-bcaced60f4a2 req-2182b1af-ca6f-4448-8113-e956c0b28618 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037019 Jun 27 21:19:31.577100 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 248/484] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:31.721330 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ad661e8b-a03a-4480-9222-599e9ff9704d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:31.721869 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ad661e8b-a03a-4480-9222-599e9ff9704d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:31.728763 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad661e8b-a03a-4480-9222-599e9ff9704d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:31.729160 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad661e8b-a03a-4480-9222-599e9ff9704d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:31.729929 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad661e8b-a03a-4480-9222-599e9ff9704d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:31.730603 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad661e8b-a03a-4480-9222-599e9ff9704d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:31.739623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-497ba696-cfbb-4460-a8e3-d3d7419e7a17 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:31.740326 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-497ba696-cfbb-4460-a8e3-d3d7419e7a17 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:31.748140 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-497ba696-cfbb-4460-a8e3-d3d7419e7a17 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:31.749018 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-497ba696-cfbb-4460-a8e3-d3d7419e7a17 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:31.750054 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-497ba696-cfbb-4460-a8e3-d3d7419e7a17 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:31.750717 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-497ba696-cfbb-4460-a8e3-d3d7419e7a17 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:31.786053 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-497ba696-cfbb-4460-a8e3-d3d7419e7a17 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:31.786495 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-497ba696-cfbb-4460-a8e3-d3d7419e7a17 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:31.786952 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-497ba696-cfbb-4460-a8e3-d3d7419e7a17 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lazy-loading 'fault' on Instance uuid b2a76ab5-ca81-472e-8d89-69e63b684ae3 {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:19:31.842044 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-497ba696-cfbb-4460-a8e3-d3d7419e7a17 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:31.851096 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-497ba696-cfbb-4460-a8e3-d3d7419e7a17 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 200 len: 1329 microversion: 2.1 time: 0.116157 Jun 27 21:19:31.852105 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 249/485] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:31 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 1329 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:31.916871 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ad661e8b-a03a-4480-9222-599e9ff9704d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:31.932351 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ad661e8b-a03a-4480-9222-599e9ff9704d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1735 microversion: 2.1 time: 0.214800 Jun 27 21:19:31.933248 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 237/486] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:31 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:32.452891 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7ef6048e-c8a0-4c07-8e5b-b0b5b28668b2 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:32.453309 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7ef6048e-c8a0-4c07-8e5b-b0b5b28668b2 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:32.460880 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7ef6048e-c8a0-4c07-8e5b-b0b5b28668b2 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:32.461364 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7ef6048e-c8a0-4c07-8e5b-b0b5b28668b2 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:32.462157 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7ef6048e-c8a0-4c07-8e5b-b0b5b28668b2 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:32.462586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7ef6048e-c8a0-4c07-8e5b-b0b5b28668b2 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:32.617078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7ef6048e-c8a0-4c07-8e5b-b0b5b28668b2 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:32.625717 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7ef6048e-c8a0-4c07-8e5b-b0b5b28668b2 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1678 microversion: 2.1 time: 0.177408 Jun 27 21:19:32.626321 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 250/487] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:32 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:32.870500 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2901cf6e-f178-4365-a365-63f763d49388 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:32.871085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2901cf6e-f178-4365-a365-63f763d49388 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:32.877964 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2901cf6e-f178-4365-a365-63f763d49388 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:32.878404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2901cf6e-f178-4365-a365-63f763d49388 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:32.879171 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2901cf6e-f178-4365-a365-63f763d49388 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:32.879601 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2901cf6e-f178-4365-a365-63f763d49388 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:32.894490 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-2901cf6e-f178-4365-a365-63f763d49388 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] HTTP exception thrown: Instance b2a76ab5-ca81-472e-8d89-69e63b684ae3 could not be found. Jun 27 21:19:32.896245 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2901cf6e-f178-4365-a365-63f763d49388 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Request method failure captured: Jun 27 21:19:32.896245 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 HTTP/1.1 Jun 27 21:19:32.896245 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:19:32.896245 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:19:32.896245 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:19:32.896245 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:19:32.896245 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:19:32.896245 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:19:32.896245 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:19:32.896245 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:19:32.896245 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh4YqTj0KDKiAA8-Ybj3-gdHviC0IY0gRPX_-zc843y94FxFezSOatXJ1qtJsvtWNZXTTXRx1zonPA_7MuDBpdKOf2Im45jkxvzu24Ha4gAYEuaWcvZ6e6-OgMyPsQ6l_aEAmdX7x7dpM8AjaVFtaQBsb85u09RPN7A4hzw049NiIF4 Jun 27 21:19:32.896245 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:19:32.896245 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:19:32.896245 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:19:32.896245 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:19:32.896245 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:19:32.896245 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:19:32.896245 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:19:32.896245 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:19:32.896245 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:19:32.896245 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:19:32.897711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a74724882c84e8f893f5be0f59a9581", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}] Jun 27 21:19:32.897711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:19:32.897711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:19:32.897711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:19:32.897711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:19:32.897711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:19:32.897711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:19:32.897711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: fff9f1fc84a54b83a7a384965f40c9d9 Jun 27 21:19:32.897711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:19:32.897711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:19:32.897711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance b2a76ab5-ca81-472e-8d89-69e63b684ae3 could not be found. Jun 27 21:19:32.897711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': 'b2a76ab5-ca81-472e-8d89-69e63b684ae3'} Jun 27 21:19:32.898570 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:19:32.898570 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:32.898570 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:19:32.898570 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:19:32.898570 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:19:32.898570 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:19:32.898570 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:19:32.898570 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:19:32.898570 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:19:32.898570 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:19:32.898570 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a76ab5-ca81-472e-8d89-69e63b684ae3 could not be found. Jun 27 21:19:32.898570 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:19:32.898570 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:19:32.898570 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:19:32.898570 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:32.898570 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:19:32.898570 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:19:32.898570 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:19:32.898570 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:19:32.898570 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:19:32.900085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:19:32.900085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:19:32.900085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:19:32.900085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:19:32.900085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:19:32.900085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:19:32.900085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:19:32.900085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a76ab5-ca81-472e-8d89-69e63b684ae3 could not be found. Jun 27 21:19:32.900085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:19:32.900085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:19:32.900085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:19:32.900085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:32.900085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:19:32.900085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:19:32.900085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:19:32.900085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:19:32.900085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a76ab5-ca81-472e-8d89-69e63b684ae3 could not be found. Jun 27 21:19:32.900085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:19:32.901413 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2901cf6e-f178-4365-a365-63f763d49388 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Returning 404 to user: Instance b2a76ab5-ca81-472e-8d89-69e63b684ae3 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:19:32.901413 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2901cf6e-f178-4365-a365-63f763d49388 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 404 len: 111 microversion: 2.1 time: 0.031568 Jun 27 21:19:32.901413 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 238/488] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:32 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:19:32.907440 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1e000fd4-7f06-42d2-bad0-5ca43b52b7e4 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '.version_select at 0x7f834f2644c0>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:32.927881 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1e000fd4-7f06-42d2-bad0-5ca43b52b7e4 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-4210487" status: 202 len: 0 microversion: 2.1 time: 0.024349 Jun 27 21:19:32.928433 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 251/489] 10.222.0.13 () {58 vars in 1211 bytes} [Mon Jun 27 21:19:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-4210487 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:19:32.950482 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3c3cc2da-3c08-4da3-bac3-3f803a461a9b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:32.951213 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3c3cc2da-3c08-4da3-bac3-3f803a461a9b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:32.958996 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c3cc2da-3c08-4da3-bac3-3f803a461a9b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:32.959446 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c3cc2da-3c08-4da3-bac3-3f803a461a9b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:32.960579 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c3cc2da-3c08-4da3-bac3-3f803a461a9b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:32.961057 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c3cc2da-3c08-4da3-bac3-3f803a461a9b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:33.142383 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3c3cc2da-3c08-4da3-bac3-3f803a461a9b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:33.152556 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3c3cc2da-3c08-4da3-bac3-3f803a461a9b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1735 microversion: 2.1 time: 0.205340 Jun 27 21:19:33.162069 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 239/490] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:32 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:33.628334 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-695a9802-1919-4050-aae4-ab1f2c8a1879 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Action: 'create', calling method: .version_select at 0x7f834f27a310>, body: {"keypair": {"name": "tempest-keypair-549687424", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfbUPQltPRPb4giW4SvRsn9d2MQBBPreY5Zb+sXlAlF9oORDChiPQ8R/Rk7BigJZlhjQpKl/lrSKMOHpH5CBZMiYhDXc9XPVR3GQmO+29YRf4bYpHKuqhI4za6DdQ9E5Q=="}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:33.643091 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-06b7f392-7d9c-4ece-803f-8427ea9ba74c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:33.643605 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-06b7f392-7d9c-4ece-803f-8427ea9ba74c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:33.645610 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-695a9802-1919-4050-aae4-ab1f2c8a1879 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Getting quotas for project 4a74724882c84e8f893f5be0f59a9581. Resources: {'key_pairs'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:19:33.649900 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-06b7f392-7d9c-4ece-803f-8427ea9ba74c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:33.650345 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-06b7f392-7d9c-4ece-803f-8427ea9ba74c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:33.650479 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-695a9802-1919-4050-aae4-ab1f2c8a1879 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Getting quotas for user fff9f1fc84a54b83a7a384965f40c9d9 and project 4a74724882c84e8f893f5be0f59a9581. Resources: {'key_pairs'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:19:33.651118 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-06b7f392-7d9c-4ece-803f-8427ea9ba74c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:33.651550 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-06b7f392-7d9c-4ece-803f-8427ea9ba74c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:33.673288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-695a9802-1919-4050-aae4-ab1f2c8a1879 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049318 Jun 27 21:19:33.673878 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 252/491] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 27 21:19:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:33.796207 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-06b7f392-7d9c-4ece-803f-8427ea9ba74c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:33.806697 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-06b7f392-7d9c-4ece-803f-8427ea9ba74c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1655 microversion: 2.1 time: 0.167187 Jun 27 21:19:33.807663 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 240/492] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:33 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1655 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:33.823786 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0185e894-5452-4011-9e65-1a4c5f6fb8fc tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:33.830108 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0185e894-5452-4011-9e65-1a4c5f6fb8fc tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:33.830552 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0185e894-5452-4011-9e65-1a4c5f6fb8fc tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:33.858942 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0185e894-5452-4011-9e65-1a4c5f6fb8fc tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Going to try to start instance {{(pid=117891) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 27 21:19:33.874947 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=100 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:33.906911 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0185e894-5452-4011-9e65-1a4c5f6fb8fc tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "POST /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1/action" status: 202 len: 0 microversion: 2.1 time: 0.086986 Jun 27 21:19:33.907526 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 253/493] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 27 21:19:33 2022] POST /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:19:33.917438 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-769457d7-b5ac-48a7-8bec-418b3e5a9338 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:33.918865 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-769457d7-b5ac-48a7-8bec-418b3e5a9338 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:33.926658 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-769457d7-b5ac-48a7-8bec-418b3e5a9338 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:33.928424 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-769457d7-b5ac-48a7-8bec-418b3e5a9338 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:33.929242 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-769457d7-b5ac-48a7-8bec-418b3e5a9338 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:33.929670 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-769457d7-b5ac-48a7-8bec-418b3e5a9338 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:34.162294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-769457d7-b5ac-48a7-8bec-418b3e5a9338 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:34.169323 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0f36afe2-d2a0-465c-9420-a9b1a94c00da tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:34.170016 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0f36afe2-d2a0-465c-9420-a9b1a94c00da tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:34.173503 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-769457d7-b5ac-48a7-8bec-418b3e5a9338 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1664 microversion: 2.1 time: 0.260363 Jun 27 21:19:34.190483 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 241/494] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:33 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1664 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:34.190690 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0f36afe2-d2a0-465c-9420-a9b1a94c00da tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:34.190690 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0f36afe2-d2a0-465c-9420-a9b1a94c00da tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:34.197241 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0f36afe2-d2a0-465c-9420-a9b1a94c00da tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:34.199810 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0f36afe2-d2a0-465c-9420-a9b1a94c00da tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:34.439044 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0f36afe2-d2a0-465c-9420-a9b1a94c00da tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:34.451824 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0f36afe2-d2a0-465c-9420-a9b1a94c00da tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1735 microversion: 2.1 time: 0.287137 Jun 27 21:19:34.452418 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 254/495] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:34 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1735 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:35.061198 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f7b12409-12c5-4bd1-9691-0b72b843f3df tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-397628946", "imageRef": "3155f228-b1ff-487e-837f-85eec68c250a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88eac9a2-e4a8-414f-a6be-c486870814c1"}], "security_groups": [{"name": "tempest-securitygroup--622917230"}], "key_name": "tempest-keypair-549687424", "user_data": "}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:35.174811 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-f7b12409-12c5-4bd1-9691-0b72b843f3df tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] validate_networks() for [('88eac9a2-e4a8-414f-a6be-c486870814c1', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:19:35.198486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-82525c00-6783-406e-a641-76ac9335f05e tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:35.199365 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-82525c00-6783-406e-a641-76ac9335f05e tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:35.206850 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-82525c00-6783-406e-a641-76ac9335f05e tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:35.207176 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-82525c00-6783-406e-a641-76ac9335f05e tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:35.207980 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-82525c00-6783-406e-a641-76ac9335f05e tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:35.208409 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-82525c00-6783-406e-a641-76ac9335f05e tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:35.354093 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-82525c00-6783-406e-a641-76ac9335f05e tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:35.361934 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-82525c00-6783-406e-a641-76ac9335f05e tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1664 microversion: 2.1 time: 0.167684 Jun 27 21:19:35.362541 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 255/496] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:35 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1664 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:35.471345 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-710c69a6-67b5-4722-942b-6843020b8519 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:35.471949 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-710c69a6-67b5-4722-942b-6843020b8519 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:35.479397 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-710c69a6-67b5-4722-942b-6843020b8519 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:35.479874 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-710c69a6-67b5-4722-942b-6843020b8519 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:35.480656 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-710c69a6-67b5-4722-942b-6843020b8519 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:35.481123 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-710c69a6-67b5-4722-942b-6843020b8519 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:35.565268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-f7b12409-12c5-4bd1-9691-0b72b843f3df tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:19:35.565688 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-f7b12409-12c5-4bd1-9691-0b72b843f3df tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:19:35.566160 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-f7b12409-12c5-4bd1-9691-0b72b843f3df tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:19:35.566562 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-f7b12409-12c5-4bd1-9691-0b72b843f3df tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:19:35.566976 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-f7b12409-12c5-4bd1-9691-0b72b843f3df tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:19:35.576755 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f7b12409-12c5-4bd1-9691-0b72b843f3df tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:35.577261 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f7b12409-12c5-4bd1-9691-0b72b843f3df tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:35.578053 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f7b12409-12c5-4bd1-9691-0b72b843f3df tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:35.578482 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f7b12409-12c5-4bd1-9691-0b72b843f3df tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:35.596627 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-f7b12409-12c5-4bd1-9691-0b72b843f3df tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Getting quotas for project 4a74724882c84e8f893f5be0f59a9581. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:19:35.600758 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-f7b12409-12c5-4bd1-9691-0b72b843f3df tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Getting quotas for user fff9f1fc84a54b83a7a384965f40c9d9 and project 4a74724882c84e8f893f5be0f59a9581. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:19:35.612817 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f7b12409-12c5-4bd1-9691-0b72b843f3df tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:19:35.615177 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f7b12409-12c5-4bd1-9691-0b72b843f3df tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3155f228-b1ff-487e-837f-85eec68c250a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:19:35.624909 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-710c69a6-67b5-4722-942b-6843020b8519 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:35.633484 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-710c69a6-67b5-4722-942b-6843020b8519 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1735 microversion: 2.1 time: 0.166454 Jun 27 21:19:35.634149 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 256/497] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:35 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:35.669130 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f7b12409-12c5-4bd1-9691-0b72b843f3df tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.612306 Jun 27 21:19:35.669850 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 242/498] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 27 21:19:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:19:35.682575 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2a38123b-6f98-4d13-99e6-ae65faa4e900 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:35.683188 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2a38123b-6f98-4d13-99e6-ae65faa4e900 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:35.749638 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2a38123b-6f98-4d13-99e6-ae65faa4e900 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:35.757063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2a38123b-6f98-4d13-99e6-ae65faa4e900 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9" status: 200 len: 1240 microversion: 2.1 time: 0.079062 Jun 27 21:19:35.757660 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 257/499] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:35 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 => generated 1240 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:36.379927 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ba51035a-5f33-4fd4-9a53-bfeb1eb737a4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:36.381243 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ba51035a-5f33-4fd4-9a53-bfeb1eb737a4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:36.389522 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ba51035a-5f33-4fd4-9a53-bfeb1eb737a4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:36.390022 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ba51035a-5f33-4fd4-9a53-bfeb1eb737a4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:36.390775 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ba51035a-5f33-4fd4-9a53-bfeb1eb737a4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:36.391202 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ba51035a-5f33-4fd4-9a53-bfeb1eb737a4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:36.540446 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ba51035a-5f33-4fd4-9a53-bfeb1eb737a4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:36.557093 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ba51035a-5f33-4fd4-9a53-bfeb1eb737a4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1668 microversion: 2.1 time: 0.181021 Jun 27 21:19:36.557676 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 243/500] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:36 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1668 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:36.651276 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2370282a-34fd-473c-8173-49aa2d5f0bd5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:36.651875 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2370282a-34fd-473c-8173-49aa2d5f0bd5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:36.658949 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2370282a-34fd-473c-8173-49aa2d5f0bd5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:36.659395 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2370282a-34fd-473c-8173-49aa2d5f0bd5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:36.660146 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2370282a-34fd-473c-8173-49aa2d5f0bd5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:36.660879 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2370282a-34fd-473c-8173-49aa2d5f0bd5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:36.774981 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-79a2273f-8450-4b62-8fe0-91a6a5521198 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:36.775596 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-79a2273f-8450-4b62-8fe0-91a6a5521198 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:36.782331 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-79a2273f-8450-4b62-8fe0-91a6a5521198 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:36.782772 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-79a2273f-8450-4b62-8fe0-91a6a5521198 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:36.783510 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-79a2273f-8450-4b62-8fe0-91a6a5521198 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:36.783949 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-79a2273f-8450-4b62-8fe0-91a6a5521198 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:36.803038 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:36.808002 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2370282a-34fd-473c-8173-49aa2d5f0bd5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:36.816195 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2370282a-34fd-473c-8173-49aa2d5f0bd5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1735 microversion: 2.1 time: 0.169024 Jun 27 21:19:36.816759 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 258/501] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:36 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:36.851616 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-79a2273f-8450-4b62-8fe0-91a6a5521198 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:36.860425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-79a2273f-8450-4b62-8fe0-91a6a5521198 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9" status: 200 len: 1292 microversion: 2.1 time: 0.089634 Jun 27 21:19:36.861467 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 244/502] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:36 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:37.834752 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1f9380e5-02ed-4135-add7-a562c6062330 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:37.836591 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1f9380e5-02ed-4135-add7-a562c6062330 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:37.844847 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1f9380e5-02ed-4135-add7-a562c6062330 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:37.845318 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1f9380e5-02ed-4135-add7-a562c6062330 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:37.846133 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1f9380e5-02ed-4135-add7-a562c6062330 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:37.846565 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1f9380e5-02ed-4135-add7-a562c6062330 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:37.878491 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-89a183db-b76f-4549-a840-5a94b906b364 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:37.879657 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-89a183db-b76f-4549-a840-5a94b906b364 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:37.889523 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89a183db-b76f-4549-a840-5a94b906b364 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:37.890189 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89a183db-b76f-4549-a840-5a94b906b364 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:37.890970 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89a183db-b76f-4549-a840-5a94b906b364 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:37.891398 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89a183db-b76f-4549-a840-5a94b906b364 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:37.994620 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1f9380e5-02ed-4135-add7-a562c6062330 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:38.004159 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1f9380e5-02ed-4135-add7-a562c6062330 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1735 microversion: 2.1 time: 0.173440 Jun 27 21:19:38.004844 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 259/503] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:37 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:38.143193 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-89a183db-b76f-4549-a840-5a94b906b364 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:38.151536 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-89a183db-b76f-4549-a840-5a94b906b364 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9" status: 200 len: 1365 microversion: 2.1 time: 0.276750 Jun 27 21:19:38.152138 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 245/504] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:37 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 => generated 1365 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:38.546949 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-35de6299-5955-4d7d-9741-8707a1f5a5be req-931a3eb9-12b4-48e1-8736-fabfbf7ff975 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "397198b2-1a3a-4947-8184-2f3c7a817da9", "tag": "614915c8-5412-4f02-82c2-94d13c38ee9b"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:38.564130 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-35de6299-5955-4d7d-9741-8707a1f5a5be req-931a3eb9-12b4-48e1-8736-fabfbf7ff975 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:38.564752 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-35de6299-5955-4d7d-9741-8707a1f5a5be req-931a3eb9-12b4-48e1-8736-fabfbf7ff975 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:38.582788 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-35de6299-5955-4d7d-9741-8707a1f5a5be req-931a3eb9-12b4-48e1-8736-fabfbf7ff975 service nova] Creating event network-changed:614915c8-5412-4f02-82c2-94d13c38ee9b for instance 397198b2-1a3a-4947-8184-2f3c7a817da9 on hv-cinder-84773 Jun 27 21:19:38.590201 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-35de6299-5955-4d7d-9741-8707a1f5a5be req-931a3eb9-12b4-48e1-8736-fabfbf7ff975 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047637 Jun 27 21:19:38.591076 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 260/505] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:39.022054 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7102ae04-abbe-45ef-b17b-f4010fac3724 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:39.022663 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7102ae04-abbe-45ef-b17b-f4010fac3724 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:39.030125 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7102ae04-abbe-45ef-b17b-f4010fac3724 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:39.030606 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7102ae04-abbe-45ef-b17b-f4010fac3724 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:39.031384 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7102ae04-abbe-45ef-b17b-f4010fac3724 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:39.031815 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7102ae04-abbe-45ef-b17b-f4010fac3724 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:39.169027 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-00eeebb8-8cb7-4556-b8cd-33f5fac75306 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:39.169720 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-00eeebb8-8cb7-4556-b8cd-33f5fac75306 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:39.173549 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7102ae04-abbe-45ef-b17b-f4010fac3724 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:39.177261 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-00eeebb8-8cb7-4556-b8cd-33f5fac75306 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:39.177750 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-00eeebb8-8cb7-4556-b8cd-33f5fac75306 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:39.178547 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-00eeebb8-8cb7-4556-b8cd-33f5fac75306 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:39.178988 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-00eeebb8-8cb7-4556-b8cd-33f5fac75306 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:39.182276 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7102ae04-abbe-45ef-b17b-f4010fac3724 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1735 microversion: 2.1 time: 0.164141 Jun 27 21:19:39.182861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 246/506] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:39 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:39.318071 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-00eeebb8-8cb7-4556-b8cd-33f5fac75306 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:39.325832 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-00eeebb8-8cb7-4556-b8cd-33f5fac75306 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9" status: 200 len: 1365 microversion: 2.1 time: 0.161457 Jun 27 21:19:39.326401 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 261/507] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:39 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:40.203725 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-247813f2-baed-403a-b272-f47cceba2ee2 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:40.204369 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-247813f2-baed-403a-b272-f47cceba2ee2 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:40.214556 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-247813f2-baed-403a-b272-f47cceba2ee2 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:40.215275 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-247813f2-baed-403a-b272-f47cceba2ee2 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:40.216141 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-247813f2-baed-403a-b272-f47cceba2ee2 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:40.216573 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-247813f2-baed-403a-b272-f47cceba2ee2 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:40.343931 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2bfbe56b-6fd8-43da-981f-a9dda31214f5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:40.344552 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2bfbe56b-6fd8-43da-981f-a9dda31214f5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:40.352102 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2bfbe56b-6fd8-43da-981f-a9dda31214f5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:40.352828 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2bfbe56b-6fd8-43da-981f-a9dda31214f5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:40.353640 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2bfbe56b-6fd8-43da-981f-a9dda31214f5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:40.354092 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2bfbe56b-6fd8-43da-981f-a9dda31214f5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:40.364843 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-247813f2-baed-403a-b272-f47cceba2ee2 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:40.373638 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-247813f2-baed-403a-b272-f47cceba2ee2 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1735 microversion: 2.1 time: 0.175152 Jun 27 21:19:40.374512 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 247/508] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:40 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:40.503494 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2bfbe56b-6fd8-43da-981f-a9dda31214f5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:40.514360 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2bfbe56b-6fd8-43da-981f-a9dda31214f5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9" status: 200 len: 1365 microversion: 2.1 time: 0.174271 Jun 27 21:19:40.514918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 262/509] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:40 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:41.391501 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d7e10bac-974d-4a1c-b2c4-e3822ef22b2a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:41.392087 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d7e10bac-974d-4a1c-b2c4-e3822ef22b2a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:41.399165 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7e10bac-974d-4a1c-b2c4-e3822ef22b2a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:41.399697 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7e10bac-974d-4a1c-b2c4-e3822ef22b2a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:41.400471 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7e10bac-974d-4a1c-b2c4-e3822ef22b2a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:41.400900 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7e10bac-974d-4a1c-b2c4-e3822ef22b2a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:41.531845 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-fe6aa3f6-58a7-4dd7-b101-c675c3802957 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:41.532619 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-fe6aa3f6-58a7-4dd7-b101-c675c3802957 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:41.540087 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fe6aa3f6-58a7-4dd7-b101-c675c3802957 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:41.540734 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fe6aa3f6-58a7-4dd7-b101-c675c3802957 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:41.541544 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fe6aa3f6-58a7-4dd7-b101-c675c3802957 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:41.541964 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fe6aa3f6-58a7-4dd7-b101-c675c3802957 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:41.547677 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d7e10bac-974d-4a1c-b2c4-e3822ef22b2a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:41.556792 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d7e10bac-974d-4a1c-b2c4-e3822ef22b2a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1735 microversion: 2.1 time: 0.169130 Jun 27 21:19:41.566048 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 248/510] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:41 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:41.707211 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-fe6aa3f6-58a7-4dd7-b101-c675c3802957 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:41.720725 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-fe6aa3f6-58a7-4dd7-b101-c675c3802957 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9" status: 200 len: 1365 microversion: 2.1 time: 0.192807 Jun 27 21:19:41.721676 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 263/511] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:41 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:42.574020 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c5176b19-5da3-4b58-a1f0-9dc0fdc71bf9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:42.574789 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c5176b19-5da3-4b58-a1f0-9dc0fdc71bf9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:42.583046 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c5176b19-5da3-4b58-a1f0-9dc0fdc71bf9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:42.584017 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c5176b19-5da3-4b58-a1f0-9dc0fdc71bf9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:42.585567 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c5176b19-5da3-4b58-a1f0-9dc0fdc71bf9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:42.587913 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c5176b19-5da3-4b58-a1f0-9dc0fdc71bf9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:42.737952 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-17deb010-d357-43c4-baec-abe9af15b1cf tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:42.738569 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-17deb010-d357-43c4-baec-abe9af15b1cf tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:42.746565 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-17deb010-d357-43c4-baec-abe9af15b1cf tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:42.746919 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-17deb010-d357-43c4-baec-abe9af15b1cf tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:42.747903 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-17deb010-d357-43c4-baec-abe9af15b1cf tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:42.748354 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-17deb010-d357-43c4-baec-abe9af15b1cf tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:42.895462 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-17deb010-d357-43c4-baec-abe9af15b1cf tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:42.903677 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-17deb010-d357-43c4-baec-abe9af15b1cf tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9" status: 200 len: 1365 microversion: 2.1 time: 0.169725 Jun 27 21:19:42.904422 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 264/512] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:42 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:43.055220 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c5176b19-5da3-4b58-a1f0-9dc0fdc71bf9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:43.066143 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c5176b19-5da3-4b58-a1f0-9dc0fdc71bf9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1715 microversion: 2.1 time: 0.495988 Jun 27 21:19:43.066940 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 249/513] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:42 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1715 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:43.176158 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c529cfcb-aa5e-4bc7-89b4-3a2fc6e5f235 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:43.176650 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c529cfcb-aa5e-4bc7-89b4-3a2fc6e5f235 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:43.183129 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c529cfcb-aa5e-4bc7-89b4-3a2fc6e5f235 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:43.183607 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c529cfcb-aa5e-4bc7-89b4-3a2fc6e5f235 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:43.184350 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c529cfcb-aa5e-4bc7-89b4-3a2fc6e5f235 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:43.184806 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c529cfcb-aa5e-4bc7-89b4-3a2fc6e5f235 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:43.268095 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-c529cfcb-aa5e-4bc7-89b4-3a2fc6e5f235 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] HTTP exception thrown: Cannot 'detach_volume' instance 3a1409c2-ecfa-4ed4-b547-aa5667367e5d while it is in vm_state rescued Jun 27 21:19:43.269836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c529cfcb-aa5e-4bc7-89b4-3a2fc6e5f235 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Request method failure captured: Jun 27 21:19:43.269836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: DELETE /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d/os-volume_attachments/be27b8ca-3335-4629-8b9d-c8fea9780a2b HTTP/1.1 Jun 27 21:19:43.269836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:19:43.269836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:19:43.269836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:19:43.269836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:19:43.269836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:19:43.269836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:19:43.269836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:19:43.269836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:19:43.269836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh4MtCUDYlYQAgDha4AvmudCjuvwvHIGW1y1KgJ39KrW_dqcQEVlDzD-XMR-AlLP_0KAJKcuGUS2Ns8xi3pVbviq_M178w8YodWUnffgx7-aVG6aPoo5C66rO-fFAe_0HQHN6yZX1qOaX4CMMRqy5foO5lwLx89IL8-rGKilhGX1QM8 Jun 27 21:19:43.269836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:19:43.269836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:19:43.269836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:19:43.269836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:19:43.269836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:19:43.269836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:19:43.269836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: a2a3853bab51428eb89ff228e5f29ef4 Jun 27 21:19:43.269836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2086275792 Jun 27 21:19:43.269836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:19:43.269836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:19:43.271495 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a2a3853bab51428eb89ff228e5f29ef4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a2a3853bab51428eb89ff228e5f29ef4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a2a3853bab51428eb89ff228e5f29ef4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a2a3853bab51428eb89ff228e5f29ef4"}]}] Jun 27 21:19:43.271495 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2086275792 Jun 27 21:19:43.271495 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: a2a3853bab51428eb89ff228e5f29ef4 Jun 27 21:19:43.271495 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2086275792 Jun 27 21:19:43.271495 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-ServerRescueNegativeTestJSON-2086275792-project Jun 27 21:19:43.271495 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:19:43.271495 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:19:43.271495 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: a0408ee5961249d1bd296a6ef1a030a9 Jun 27 21:19:43.271495 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2086275792-project Jun 27 21:19:43.271495 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: > Jun 27 21:19:43.271495 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Cannot 'detach_volume' instance 3a1409c2-ecfa-4ed4-b547-aa5667367e5d while it is in vm_state rescued Jun 27 21:19:43.272377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'server_id': '3a1409c2-ecfa-4ed4-b547-aa5667367e5d', 'id': 'be27b8ca-3335-4629-8b9d-c8fea9780a2b'} Jun 27 21:19:43.272377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:19:43.272377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:43.272377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 27 21:19:43.272377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 27 21:19:43.272377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 21:19:43.272377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 21:19:43.272377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 27 21:19:43.272377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 27 21:19:43.272377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3a1409c2-ecfa-4ed4-b547-aa5667367e5d in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 27 21:19:43.272377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:19:43.272377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:19:43.272377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:19:43.272377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:43.272377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:19:43.272377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:19:43.272377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:19:43.272377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:19:43.272377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:19:43.272377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:19:43.274263 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 27 21:19:43.274263 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 27 21:19:43.274263 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 27 21:19:43.274263 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 27 21:19:43.274263 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3a1409c2-ecfa-4ed4-b547-aa5667367e5d while it is in vm_state rescued Jun 27 21:19:43.274263 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:19:43.274263 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:19:43.274263 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:19:43.274263 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:43.274263 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:19:43.274263 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:19:43.274263 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:19:43.274263 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:19:43.274263 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3a1409c2-ecfa-4ed4-b547-aa5667367e5d while it is in vm_state rescued Jun 27 21:19:43.274263 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:19:43.274263 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c529cfcb-aa5e-4bc7-89b4-3a2fc6e5f235 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Returning 409 to user: Cannot 'detach_volume' instance 3a1409c2-ecfa-4ed4-b547-aa5667367e5d while it is in vm_state rescued {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:19:43.275776 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c529cfcb-aa5e-4bc7-89b4-3a2fc6e5f235 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d/os-volume_attachments/be27b8ca-3335-4629-8b9d-c8fea9780a2b" status: 409 len: 152 microversion: 2.1 time: 0.099131 Jun 27 21:19:43.275776 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 265/514] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 27 21:19:43 2022] DELETE /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d/os-volume_attachments/be27b8ca-3335-4629-8b9d-c8fea9780a2b => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 27 21:19:43.280371 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b9bb59ae-73b5-4a65-9b8e-f71d0547a097 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:43.280899 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b9bb59ae-73b5-4a65-9b8e-f71d0547a097 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:43.286967 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b9bb59ae-73b5-4a65-9b8e-f71d0547a097 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:43.287412 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b9bb59ae-73b5-4a65-9b8e-f71d0547a097 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:43.288167 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b9bb59ae-73b5-4a65-9b8e-f71d0547a097 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:43.288601 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b9bb59ae-73b5-4a65-9b8e-f71d0547a097 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:43.356781 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b9bb59ae-73b5-4a65-9b8e-f71d0547a097 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "POST /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d/action" status: 202 len: 0 microversion: 2.1 time: 0.080141 Jun 27 21:19:43.360056 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 250/515] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 27 21:19:43 2022] POST /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:19:43.366034 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e0b52196-6943-45c4-8f48-116b976e000a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:43.366801 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e0b52196-6943-45c4-8f48-116b976e000a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:43.373814 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e0b52196-6943-45c4-8f48-116b976e000a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:43.374296 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e0b52196-6943-45c4-8f48-116b976e000a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:43.375093 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e0b52196-6943-45c4-8f48-116b976e000a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:43.375524 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e0b52196-6943-45c4-8f48-116b976e000a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:43.514862 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e0b52196-6943-45c4-8f48-116b976e000a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:43.523257 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e0b52196-6943-45c4-8f48-116b976e000a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1723 microversion: 2.1 time: 0.161067 Jun 27 21:19:43.523780 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 266/516] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:43 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:43.922706 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0f836c9a-8075-4147-8b8e-0d86ca9103e8 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:43.923410 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0f836c9a-8075-4147-8b8e-0d86ca9103e8 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:43.930341 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f836c9a-8075-4147-8b8e-0d86ca9103e8 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:43.930938 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f836c9a-8075-4147-8b8e-0d86ca9103e8 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:43.931699 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f836c9a-8075-4147-8b8e-0d86ca9103e8 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:43.932128 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f836c9a-8075-4147-8b8e-0d86ca9103e8 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:44.080041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0f836c9a-8075-4147-8b8e-0d86ca9103e8 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:44.088142 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0f836c9a-8075-4147-8b8e-0d86ca9103e8 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9" status: 200 len: 1365 microversion: 2.1 time: 0.170355 Jun 27 21:19:44.088685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 251/517] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:43 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:44.540258 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7fc86a9d-4f2f-4ae7-a440-48c8d3b79774 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:44.540874 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7fc86a9d-4f2f-4ae7-a440-48c8d3b79774 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:44.548213 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7fc86a9d-4f2f-4ae7-a440-48c8d3b79774 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:44.548661 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7fc86a9d-4f2f-4ae7-a440-48c8d3b79774 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:44.549470 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7fc86a9d-4f2f-4ae7-a440-48c8d3b79774 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:44.549902 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7fc86a9d-4f2f-4ae7-a440-48c8d3b79774 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:44.687282 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7fc86a9d-4f2f-4ae7-a440-48c8d3b79774 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:44.695843 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7fc86a9d-4f2f-4ae7-a440-48c8d3b79774 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1723 microversion: 2.1 time: 0.159621 Jun 27 21:19:44.697080 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 267/518] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:44 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:45.105608 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3ca32310-e184-4168-aa64-cb91848c0749 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:45.106192 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3ca32310-e184-4168-aa64-cb91848c0749 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:45.115996 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3ca32310-e184-4168-aa64-cb91848c0749 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:45.116508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3ca32310-e184-4168-aa64-cb91848c0749 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:45.117363 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3ca32310-e184-4168-aa64-cb91848c0749 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:45.117846 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3ca32310-e184-4168-aa64-cb91848c0749 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:45.263533 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3ca32310-e184-4168-aa64-cb91848c0749 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:45.271337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3ca32310-e184-4168-aa64-cb91848c0749 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9" status: 200 len: 1365 microversion: 2.1 time: 0.169754 Jun 27 21:19:45.271831 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 252/519] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:45 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:45.716224 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f435c534-64d1-47b0-abbf-5630d8c8dec5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:45.716943 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f435c534-64d1-47b0-abbf-5630d8c8dec5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:45.723696 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f435c534-64d1-47b0-abbf-5630d8c8dec5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:45.724136 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f435c534-64d1-47b0-abbf-5630d8c8dec5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:45.724900 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f435c534-64d1-47b0-abbf-5630d8c8dec5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:45.725357 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f435c534-64d1-47b0-abbf-5630d8c8dec5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:45.755688 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=6 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:45.873744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f435c534-64d1-47b0-abbf-5630d8c8dec5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:45.881806 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f435c534-64d1-47b0-abbf-5630d8c8dec5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1723 microversion: 2.1 time: 0.169705 Jun 27 21:19:45.882379 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 268/520] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:45 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:46.290336 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0e206652-214e-4c93-99a2-cf40c52f17fe tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:46.291554 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0e206652-214e-4c93-99a2-cf40c52f17fe tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:46.294229 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:46.294962 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:46.296316 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:46.302698 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e206652-214e-4c93-99a2-cf40c52f17fe tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:46.303188 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e206652-214e-4c93-99a2-cf40c52f17fe tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:46.303974 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e206652-214e-4c93-99a2-cf40c52f17fe tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:46.304438 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e206652-214e-4c93-99a2-cf40c52f17fe tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:46.435647 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-a26737f6-4b43-4795-8a4e-6cebb8f291b4 req-002ceff4-9258-4458-85fd-1a3d3a3b7526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397198b2-1a3a-4947-8184-2f3c7a817da9", "name": "network-vif-plugged", "status": "completed", "tag": "614915c8-5412-4f02-82c2-94d13c38ee9b"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:46.446184 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-a26737f6-4b43-4795-8a4e-6cebb8f291b4 req-002ceff4-9258-4458-85fd-1a3d3a3b7526 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:46.446765 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-a26737f6-4b43-4795-8a4e-6cebb8f291b4 req-002ceff4-9258-4458-85fd-1a3d3a3b7526 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:46.471208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-a26737f6-4b43-4795-8a4e-6cebb8f291b4 req-002ceff4-9258-4458-85fd-1a3d3a3b7526 service nova] Creating event network-vif-plugged:614915c8-5412-4f02-82c2-94d13c38ee9b for instance 397198b2-1a3a-4947-8184-2f3c7a817da9 on hv-cinder-84773 Jun 27 21:19:46.480294 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-a26737f6-4b43-4795-8a4e-6cebb8f291b4 req-002ceff4-9258-4458-85fd-1a3d3a3b7526 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050464 Jun 27 21:19:46.481678 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 269/521] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:46.596340 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0e206652-214e-4c93-99a2-cf40c52f17fe tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:46.609545 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0e206652-214e-4c93-99a2-cf40c52f17fe tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9" status: 200 len: 1365 microversion: 2.1 time: 0.324267 Jun 27 21:19:46.610681 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 253/522] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:46 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 => generated 1365 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:46.900420 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a0c99056-6514-4ce4-91ad-3f5912321b63 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:46.901494 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a0c99056-6514-4ce4-91ad-3f5912321b63 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:46.908059 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a0c99056-6514-4ce4-91ad-3f5912321b63 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:46.908468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a0c99056-6514-4ce4-91ad-3f5912321b63 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:46.909613 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a0c99056-6514-4ce4-91ad-3f5912321b63 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:46.909743 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a0c99056-6514-4ce4-91ad-3f5912321b63 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:47.045609 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a0c99056-6514-4ce4-91ad-3f5912321b63 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:47.053967 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a0c99056-6514-4ce4-91ad-3f5912321b63 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1729 microversion: 2.1 time: 0.158426 Jun 27 21:19:47.054545 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 270/523] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:46 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:47.071507 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4eeca2aa-dd13-4419-9b05-5af7654598de tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:47.072104 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4eeca2aa-dd13-4419-9b05-5af7654598de tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:47.079106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4eeca2aa-dd13-4419-9b05-5af7654598de tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:47.079555 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4eeca2aa-dd13-4419-9b05-5af7654598de tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:47.080324 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4eeca2aa-dd13-4419-9b05-5af7654598de tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:47.080754 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4eeca2aa-dd13-4419-9b05-5af7654598de tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:47.163440 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4eeca2aa-dd13-4419-9b05-5af7654598de tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095497 Jun 27 21:19:47.164635 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 254/524] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 27 21:19:47 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:47.632005 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-09f0c9e3-f993-4459-8761-ba71eded0a29 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:47.633674 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-09f0c9e3-f993-4459-8761-ba71eded0a29 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:47.640861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-09f0c9e3-f993-4459-8761-ba71eded0a29 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:47.641367 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-09f0c9e3-f993-4459-8761-ba71eded0a29 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:47.642153 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-09f0c9e3-f993-4459-8761-ba71eded0a29 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:47.642546 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-09f0c9e3-f993-4459-8761-ba71eded0a29 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:47.814884 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-09f0c9e3-f993-4459-8761-ba71eded0a29 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:47.825544 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-09f0c9e3-f993-4459-8761-ba71eded0a29 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9" status: 200 len: 1365 microversion: 2.1 time: 0.200391 Jun 27 21:19:47.826149 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 271/525] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:47 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:48.237345 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-f6ebd136-69c2-4976-b99a-ecdd0f1ca845 req-c487fcd7-534a-4a50-9e43-14016bd5c1b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a1409c2-ecfa-4ed4-b547-aa5667367e5d", "tag": "b9348a43-0456-47cf-97ba-a8ab01ba6107"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:48.264875 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-f6ebd136-69c2-4976-b99a-ecdd0f1ca845 req-c487fcd7-534a-4a50-9e43-14016bd5c1b8 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:48.266067 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-f6ebd136-69c2-4976-b99a-ecdd0f1ca845 req-c487fcd7-534a-4a50-9e43-14016bd5c1b8 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:48.283739 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-f6ebd136-69c2-4976-b99a-ecdd0f1ca845 req-c487fcd7-534a-4a50-9e43-14016bd5c1b8 service nova] Creating event network-changed:b9348a43-0456-47cf-97ba-a8ab01ba6107 for instance 3a1409c2-ecfa-4ed4-b547-aa5667367e5d on hv-cinder-84773 Jun 27 21:19:48.289385 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-f6ebd136-69c2-4976-b99a-ecdd0f1ca845 req-c487fcd7-534a-4a50-9e43-14016bd5c1b8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061294 Jun 27 21:19:48.290553 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 255/526] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:19:48.842945 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b55df1fc-932c-46b3-b1c4-6a94e7be2be2 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:48.843865 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b55df1fc-932c-46b3-b1c4-6a94e7be2be2 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:48.851602 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b55df1fc-932c-46b3-b1c4-6a94e7be2be2 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:48.852262 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b55df1fc-932c-46b3-b1c4-6a94e7be2be2 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:48.852880 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b55df1fc-932c-46b3-b1c4-6a94e7be2be2 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:48.853800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b55df1fc-932c-46b3-b1c4-6a94e7be2be2 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:48.858894 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:49.048495 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b55df1fc-932c-46b3-b1c4-6a94e7be2be2 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:49.062915 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b55df1fc-932c-46b3-b1c4-6a94e7be2be2 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9" status: 200 len: 1554 microversion: 2.1 time: 0.223636 Jun 27 21:19:49.063910 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 272/527] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:48 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 => generated 1554 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:49.081875 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-68dd1332-b498-43a9-a779-a0df179dc8b6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:49.082455 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-68dd1332-b498-43a9-a779-a0df179dc8b6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:49.090231 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-68dd1332-b498-43a9-a779-a0df179dc8b6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:49.090948 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-68dd1332-b498-43a9-a779-a0df179dc8b6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:49.091922 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-68dd1332-b498-43a9-a779-a0df179dc8b6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:49.092512 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-68dd1332-b498-43a9-a779-a0df179dc8b6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:49.192594 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-68dd1332-b498-43a9-a779-a0df179dc8b6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114609 Jun 27 21:19:49.193581 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 256/528] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 27 21:19:49 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:50.317100 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-29c90a9a-c1d9-46f3-a990-979172bba909 req-a3e7a3b6-09d5-4eff-b0eb-f3c9e4115776 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a1409c2-ecfa-4ed4-b547-aa5667367e5d", "tag": "b9348a43-0456-47cf-97ba-a8ab01ba6107"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:50.333373 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-29c90a9a-c1d9-46f3-a990-979172bba909 req-a3e7a3b6-09d5-4eff-b0eb-f3c9e4115776 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:50.334134 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-29c90a9a-c1d9-46f3-a990-979172bba909 req-a3e7a3b6-09d5-4eff-b0eb-f3c9e4115776 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:50.356557 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-29c90a9a-c1d9-46f3-a990-979172bba909 req-a3e7a3b6-09d5-4eff-b0eb-f3c9e4115776 service nova] Creating event network-changed:b9348a43-0456-47cf-97ba-a8ab01ba6107 for instance 3a1409c2-ecfa-4ed4-b547-aa5667367e5d on hv-cinder-84773 Jun 27 21:19:50.365426 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-29c90a9a-c1d9-46f3-a990-979172bba909 req-a3e7a3b6-09d5-4eff-b0eb-f3c9e4115776 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055092 Jun 27 21:19:50.366495 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 273/529] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:52.382467 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-eba50d69-08bf-4df6-baac-ddf6a5e3228e req-1351211a-7309-424c-a6d4-c0372a0a1cab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "397198b2-1a3a-4947-8184-2f3c7a817da9", "tag": "614915c8-5412-4f02-82c2-94d13c38ee9b"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:52.391671 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-eba50d69-08bf-4df6-baac-ddf6a5e3228e req-1351211a-7309-424c-a6d4-c0372a0a1cab service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:52.392760 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-eba50d69-08bf-4df6-baac-ddf6a5e3228e req-1351211a-7309-424c-a6d4-c0372a0a1cab service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:52.406001 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-eba50d69-08bf-4df6-baac-ddf6a5e3228e req-1351211a-7309-424c-a6d4-c0372a0a1cab service nova] Creating event network-changed:614915c8-5412-4f02-82c2-94d13c38ee9b for instance 397198b2-1a3a-4947-8184-2f3c7a817da9 on hv-cinder-84773 Jun 27 21:19:52.410998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-eba50d69-08bf-4df6-baac-ddf6a5e3228e req-1351211a-7309-424c-a6d4-c0372a0a1cab service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032856 Jun 27 21:19:52.411634 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 257/530] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:58.876078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d7db4cc7-2377-4d05-b65a-d90f7300f186 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:58.876631 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d7db4cc7-2377-4d05-b65a-d90f7300f186 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:58.883425 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d7db4cc7-2377-4d05-b65a-d90f7300f186 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:58.883866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d7db4cc7-2377-4d05-b65a-d90f7300f186 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:58.885183 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d7db4cc7-2377-4d05-b65a-d90f7300f186 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:58.885305 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d7db4cc7-2377-4d05-b65a-d90f7300f186 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:58.915929 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d7db4cc7-2377-4d05-b65a-d90f7300f186 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1/os-volume_attachments/a64669da-c04e-474b-8842-eb58dda7310c" status: 200 len: 194 microversion: 2.20 time: 0.044854 Jun 27 21:19:58.916550 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 274/531] 10.222.0.13 () {60 vars in 1453 bytes} [Mon Jun 27 21:19:58 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1/os-volume_attachments/a64669da-c04e-474b-8842-eb58dda7310c => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:19:58.984131 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8734ecfd-eee1-4d0d-a73e-c4503fa11d1c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:58.984722 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8734ecfd-eee1-4d0d-a73e-c4503fa11d1c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:58.991289 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8734ecfd-eee1-4d0d-a73e-c4503fa11d1c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:58.991732 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8734ecfd-eee1-4d0d-a73e-c4503fa11d1c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:58.992553 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8734ecfd-eee1-4d0d-a73e-c4503fa11d1c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:58.993009 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8734ecfd-eee1-4d0d-a73e-c4503fa11d1c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:59.084048 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-8734ecfd-eee1-4d0d-a73e-c4503fa11d1c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lazy-loading 'services' on Instance uuid 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:19:59.165053 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8734ecfd-eee1-4d0d-a73e-c4503fa11d1c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1/os-volume_attachments/a64669da-c04e-474b-8842-eb58dda7310c" status: 202 len: 0 microversion: 2.20 time: 0.185935 Jun 27 21:19:59.165863 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 258/532] 10.222.0.13 () {60 vars in 1456 bytes} [Mon Jun 27 21:19:58 2022] DELETE /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1/os-volume_attachments/a64669da-c04e-474b-8842-eb58dda7310c => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:19:59.174612 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9e658b12-90f4-44b0-9cde-90e4566f432a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:59.175534 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9e658b12-90f4-44b0-9cde-90e4566f432a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:59.182522 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9e658b12-90f4-44b0-9cde-90e4566f432a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:59.182970 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9e658b12-90f4-44b0-9cde-90e4566f432a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:59.183775 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9e658b12-90f4-44b0-9cde-90e4566f432a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:59.184205 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9e658b12-90f4-44b0-9cde-90e4566f432a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:59.221200 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9e658b12-90f4-44b0-9cde-90e4566f432a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050609 Jun 27 21:19:59.221779 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 275/533] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Jun 27 21:19:59 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:20:00.234405 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e9d8690a-056c-49e9-9039-bf240e559b21 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:00.235395 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e9d8690a-056c-49e9-9039-bf240e559b21 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:00.243872 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e9d8690a-056c-49e9-9039-bf240e559b21 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:00.244320 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e9d8690a-056c-49e9-9039-bf240e559b21 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:00.245146 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e9d8690a-056c-49e9-9039-bf240e559b21 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:00.245583 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e9d8690a-056c-49e9-9039-bf240e559b21 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:00.278576 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e9d8690a-056c-49e9-9039-bf240e559b21 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049037 Jun 27 21:20:00.279170 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 259/534] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Jun 27 21:20:00 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:00.351165 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-cb833294-62ee-4b3f-8207-4fce6052fab7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:00.351765 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-cb833294-62ee-4b3f-8207-4fce6052fab7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:00.354289 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:00.360060 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cb833294-62ee-4b3f-8207-4fce6052fab7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:00.360504 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cb833294-62ee-4b3f-8207-4fce6052fab7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:00.361325 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cb833294-62ee-4b3f-8207-4fce6052fab7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:00.361748 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cb833294-62ee-4b3f-8207-4fce6052fab7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:00.389798 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-cb833294-62ee-4b3f-8207-4fce6052fab7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Going to try to terminate instance {{(pid=117891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:20:00.473910 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-cb833294-62ee-4b3f-8207-4fce6052fab7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 204 len: 0 microversion: 2.20 time: 0.125797 Jun 27 21:20:00.473910 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 276/535] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Jun 27 21:20:00 2022] DELETE /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 27 21:20:00.483095 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-66091c45-3fbc-4b73-ab33-a6906f5b08e3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:00.483817 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-66091c45-3fbc-4b73-ab33-a6906f5b08e3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:00.490649 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66091c45-3fbc-4b73-ab33-a6906f5b08e3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:00.491311 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66091c45-3fbc-4b73-ab33-a6906f5b08e3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:00.492082 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66091c45-3fbc-4b73-ab33-a6906f5b08e3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:00.492515 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66091c45-3fbc-4b73-ab33-a6906f5b08e3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:00.635028 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-66091c45-3fbc-4b73-ab33-a6906f5b08e3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:00.643649 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-66091c45-3fbc-4b73-ab33-a6906f5b08e3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:00.645225 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-66091c45-3fbc-4b73-ab33-a6906f5b08e3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:00.646419 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-66091c45-3fbc-4b73-ab33-a6906f5b08e3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1722 microversion: 2.20 time: 0.167751 Jun 27 21:20:00.646957 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 260/536] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:00 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:01.666726 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f060ac07-e4da-42eb-9449-6a8722913f8d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:01.667444 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f060ac07-e4da-42eb-9449-6a8722913f8d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:01.674870 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f060ac07-e4da-42eb-9449-6a8722913f8d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:01.675298 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f060ac07-e4da-42eb-9449-6a8722913f8d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:01.676080 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f060ac07-e4da-42eb-9449-6a8722913f8d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:01.676515 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f060ac07-e4da-42eb-9449-6a8722913f8d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:01.816087 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f060ac07-e4da-42eb-9449-6a8722913f8d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:01.828362 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f060ac07-e4da-42eb-9449-6a8722913f8d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:01.830533 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f060ac07-e4da-42eb-9449-6a8722913f8d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:01.832025 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f060ac07-e4da-42eb-9449-6a8722913f8d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1722 microversion: 2.20 time: 0.169712 Jun 27 21:20:01.832840 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 277/537] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:01 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:02.852496 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b45be5b6-81ca-4419-ae87-b62a20c696bf tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:02.854529 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b45be5b6-81ca-4419-ae87-b62a20c696bf tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:02.861753 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b45be5b6-81ca-4419-ae87-b62a20c696bf tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:02.862198 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b45be5b6-81ca-4419-ae87-b62a20c696bf tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:02.862985 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b45be5b6-81ca-4419-ae87-b62a20c696bf tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:02.863422 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b45be5b6-81ca-4419-ae87-b62a20c696bf tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:02.885385 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:03.069178 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b45be5b6-81ca-4419-ae87-b62a20c696bf tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:03.078835 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b45be5b6-81ca-4419-ae87-b62a20c696bf tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:03.080361 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b45be5b6-81ca-4419-ae87-b62a20c696bf tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:03.081563 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b45be5b6-81ca-4419-ae87-b62a20c696bf tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 200 len: 1722 microversion: 2.20 time: 0.233250 Jun 27 21:20:03.082116 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 261/538] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:02 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:03.442929 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-3a73744c-4cf2-4c06-bc63-7fdd390b5268 req-57460fbf-b06e-46d8-9e3a-828d7db4c739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b28fb7f-5684-4656-bd7c-b6d7d15790b1", "name": "network-vif-deleted", "tag": "c722f6d7-3bed-4343-ad5e-1c84bfc3ac4e"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:03.455362 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-3a73744c-4cf2-4c06-bc63-7fdd390b5268 req-57460fbf-b06e-46d8-9e3a-828d7db4c739 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:03.455876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-3a73744c-4cf2-4c06-bc63-7fdd390b5268 req-57460fbf-b06e-46d8-9e3a-828d7db4c739 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:03.470844 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-3a73744c-4cf2-4c06-bc63-7fdd390b5268 req-57460fbf-b06e-46d8-9e3a-828d7db4c739 service nova] Creating event network-vif-deleted:c722f6d7-3bed-4343-ad5e-1c84bfc3ac4e for instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 on hv-cinder-84773 Jun 27 21:20:03.478166 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-3a73744c-4cf2-4c06-bc63-7fdd390b5268 req-57460fbf-b06e-46d8-9e3a-828d7db4c739 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038498 Jun 27 21:20:03.479184 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 278/539] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:04.101959 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2693b38d-54c2-40c6-8552-ce6af66781df tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:04.102552 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2693b38d-54c2-40c6-8552-ce6af66781df tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:04.110257 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2693b38d-54c2-40c6-8552-ce6af66781df tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:04.110711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2693b38d-54c2-40c6-8552-ce6af66781df tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:04.111787 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2693b38d-54c2-40c6-8552-ce6af66781df tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:04.112216 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2693b38d-54c2-40c6-8552-ce6af66781df tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:04.128800 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-2693b38d-54c2-40c6-8552-ce6af66781df tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] HTTP exception thrown: Instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 could not be found. Jun 27 21:20:04.130828 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2693b38d-54c2-40c6-8552-ce6af66781df tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Request method failure captured: Jun 27 21:20:04.130828 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 HTTP/1.1 Jun 27 21:20:04.130828 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:20:04.130828 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:20:04.130828 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:20:04.130828 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:20:04.130828 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:20:04.130828 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:20:04.130828 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:20:04.130828 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:20:04.130828 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh4ij4MXukhTsQNAKHvTHyJFtxeKdT4NwC6Ja1qGf4jY74bgMKzIfBw4fCQFB2OgIPN_rqP1YuXuOBuskMmhRPs0hrdO81hV9tZo9lmNv6aC5B8Ij0gINsAPuvw1-7YZdoiZ2fKp3Lq5N1vfvBIxzRA3_1sjPFvwjKkr0sFgY1h5BzQ Jun 27 21:20:04.130828 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:20:04.130828 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:20:04.130828 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:20:04.130828 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:20:04.130828 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 21:20:04.130828 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:20:04.130828 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:20:04.130828 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 0cdaf724b92644a0ae7fbb71147aef40 Jun 27 21:20:04.130828 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-133090922 Jun 27 21:20:04.130828 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:20:04.130828 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:20:04.132243 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0cdaf724b92644a0ae7fbb71147aef40", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0cdaf724b92644a0ae7fbb71147aef40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0cdaf724b92644a0ae7fbb71147aef40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0cdaf724b92644a0ae7fbb71147aef40"}]}] Jun 27 21:20:04.132243 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeShelveTestJSON-133090922 Jun 27 21:20:04.132243 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 0cdaf724b92644a0ae7fbb71147aef40 Jun 27 21:20:04.132243 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-133090922 Jun 27 21:20:04.132243 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeShelveTestJSON-133090922-project Jun 27 21:20:04.132243 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:20:04.132243 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:20:04.132243 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: ba0127dd69da407ab096773fc9e22530 Jun 27 21:20:04.132243 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeShelveTestJSON-133090922-project Jun 27 21:20:04.132243 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:20:04.132243 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 could not be found. Jun 27 21:20:04.132243 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '2b28fb7f-5684-4656-bd7c-b6d7d15790b1'} Jun 27 21:20:04.133041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:20:04.133041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:04.133041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:20:04.133041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:20:04.133041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:20:04.133041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:20:04.133041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:20:04.133041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:20:04.133041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:20:04.133041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:20:04.133041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 could not be found. Jun 27 21:20:04.133041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:20:04.133041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:20:04.133041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:20:04.133041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:04.133041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:20:04.133041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:20:04.133041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:20:04.133041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:20:04.133041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:20:04.134368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:20:04.134368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:20:04.134368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:20:04.134368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:20:04.134368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:20:04.134368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:20:04.134368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:20:04.134368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 could not be found. Jun 27 21:20:04.134368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:20:04.134368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:20:04.134368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:20:04.134368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:04.134368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:20:04.134368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:20:04.134368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:20:04.134368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:20:04.134368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 could not be found. Jun 27 21:20:04.134368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:20:04.135462 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2693b38d-54c2-40c6-8552-ce6af66781df tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Returning 404 to user: Instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:20:04.135462 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2693b38d-54c2-40c6-8552-ce6af66781df tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 404 len: 111 microversion: 2.20 time: 0.034633 Jun 27 21:20:04.135462 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 262/540] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:04 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 21:20:04.142348 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3d8a2883-4e3a-45ca-9305-39106522047e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '.version_select at 0x7f834f3658b0>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:04.161651 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3d8a2883-4e3a-45ca-9305-39106522047e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2107055284" status: 204 len: 0 microversion: 2.20 time: 0.023636 Jun 27 21:20:04.162268 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 279/541] 10.222.0.13 () {60 vars in 1261 bytes} [Mon Jun 27 21:20:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2107055284 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 27 21:20:04.796872 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2364cc44-9694-45fc-b421-f14fb90bfca2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Action: 'create', calling method: .version_select at 0x7f835428a160>, body: {"keypair": {"name": "tempest-keypair-59522158", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELEPXQq/PNFrvO5IIxQFhZOoYNQSrKXcY6Wf1XN0p89mRegny/SzU4HpCW1tjDnvSr/vZ8n4PDI7yg2Q3jY7TUPZbYAje9Z3xq88r1nbakPVB0+jefhPcnrosTmRdSzvg=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:04.812639 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-2364cc44-9694-45fc-b421-f14fb90bfca2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Getting quotas for project 0cdaf724b92644a0ae7fbb71147aef40. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:20:04.817084 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-2364cc44-9694-45fc-b421-f14fb90bfca2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Getting quotas for user ba0127dd69da407ab096773fc9e22530 and project 0cdaf724b92644a0ae7fbb71147aef40. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:20:04.842867 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2364cc44-9694-45fc-b421-f14fb90bfca2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.050426 Jun 27 21:20:04.843633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 263/542] 10.222.0.13 () {62 vars in 1199 bytes} [Mon Jun 27 21:20:04 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 27 21:20:06.526464 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b33d4ec0-756a-42d8-a19c-437b13d39648 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-19814493", "imageRef": "3155f228-b1ff-487e-837f-85eec68c250a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "449e2e33-47ed-4bc8-9db3-ee1c9d54d111"}], "security_groups": [{"name": "tempest-securitygroup--2130913296"}], "key_name": "tempest-keypair-59522158", "user_data": "}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:06.641792 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.network.neutron [None req-b33d4ec0-756a-42d8-a19c-437b13d39648 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] validate_networks() for [('449e2e33-47ed-4bc8-9db3-ee1c9d54d111', None, None, None, None, None)] {{(pid=117891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:20:07.031833 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-b33d4ec0-756a-42d8-a19c-437b13d39648 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Flavor limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:20:07.032233 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-b33d4ec0-756a-42d8-a19c-437b13d39648 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Image limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:20:07.032692 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-b33d4ec0-756a-42d8-a19c-437b13d39648 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Flavor pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:20:07.033121 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-b33d4ec0-756a-42d8-a19c-437b13d39648 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Image pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:20:07.033522 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-b33d4ec0-756a-42d8-a19c-437b13d39648 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:20:07.043798 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b33d4ec0-756a-42d8-a19c-437b13d39648 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:07.044737 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b33d4ec0-756a-42d8-a19c-437b13d39648 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:07.045179 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b33d4ec0-756a-42d8-a19c-437b13d39648 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:07.045638 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b33d4ec0-756a-42d8-a19c-437b13d39648 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:07.063861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-b33d4ec0-756a-42d8-a19c-437b13d39648 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Getting quotas for project 0cdaf724b92644a0ae7fbb71147aef40. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:20:07.067820 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-b33d4ec0-756a-42d8-a19c-437b13d39648 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Getting quotas for user ba0127dd69da407ab096773fc9e22530 and project 0cdaf724b92644a0ae7fbb71147aef40. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:20:07.080062 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b33d4ec0-756a-42d8-a19c-437b13d39648 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Going to run 1 instances... {{(pid=117891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:20:07.082417 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b33d4ec0-756a-42d8-a19c-437b13d39648 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3155f228-b1ff-487e-837f-85eec68c250a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:20:07.129947 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b33d4ec0-756a-42d8-a19c-437b13d39648 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.608737 Jun 27 21:20:07.130597 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 280/543] 10.222.0.13 () {62 vars in 1187 bytes} [Mon Jun 27 21:20:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 27 21:20:07.141420 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b2f868ac-f323-4bfa-997f-b8641310dc45 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:07.142304 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b2f868ac-f323-4bfa-997f-b8641310dc45 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:07.204718 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b2f868ac-f323-4bfa-997f-b8641310dc45 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:07.215116 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b2f868ac-f323-4bfa-997f-b8641310dc45 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:07.217754 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b2f868ac-f323-4bfa-997f-b8641310dc45 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:07.218938 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b2f868ac-f323-4bfa-997f-b8641310dc45 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1278 microversion: 2.20 time: 0.081661 Jun 27 21:20:07.219468 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 264/544] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:07 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1278 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:08.239424 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a893a57b-f36c-464f-8d73-827a46bcfb7f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:08.240046 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a893a57b-f36c-464f-8d73-827a46bcfb7f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:08.248886 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a893a57b-f36c-464f-8d73-827a46bcfb7f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:08.249332 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a893a57b-f36c-464f-8d73-827a46bcfb7f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:08.250320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a893a57b-f36c-464f-8d73-827a46bcfb7f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:08.250745 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a893a57b-f36c-464f-8d73-827a46bcfb7f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:08.324768 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a893a57b-f36c-464f-8d73-827a46bcfb7f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:08.335660 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a893a57b-f36c-464f-8d73-827a46bcfb7f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:08.337207 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a893a57b-f36c-464f-8d73-827a46bcfb7f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:08.339590 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a893a57b-f36c-464f-8d73-827a46bcfb7f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1338 microversion: 2.20 time: 0.104848 Jun 27 21:20:08.350448 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 281/545] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:08 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1338 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:09.358855 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-21541680-d1fe-4436-a0dd-a2930a871e01 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:09.359484 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-21541680-d1fe-4436-a0dd-a2930a871e01 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:09.366346 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-21541680-d1fe-4436-a0dd-a2930a871e01 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:09.366790 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-21541680-d1fe-4436-a0dd-a2930a871e01 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:09.367575 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-21541680-d1fe-4436-a0dd-a2930a871e01 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:09.368007 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-21541680-d1fe-4436-a0dd-a2930a871e01 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:09.570498 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-21541680-d1fe-4436-a0dd-a2930a871e01 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:09.580169 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-21541680-d1fe-4436-a0dd-a2930a871e01 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:09.581723 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-21541680-d1fe-4436-a0dd-a2930a871e01 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:09.582920 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-21541680-d1fe-4436-a0dd-a2930a871e01 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1404 microversion: 2.20 time: 0.228079 Jun 27 21:20:09.583494 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 265/546] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:09 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1404 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:09.867127 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-4795569f-5e4c-4acc-bb02-240ab37bcbb6 req-8f35bd0a-d2e0-4a2d-8e43-bdcd8c61033f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a775668d-41e5-407f-ad33-a3b265985d10", "tag": "b19d4fbb-0cf8-4c5b-b7e2-ad5cd60e8812"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:09.876448 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-4795569f-5e4c-4acc-bb02-240ab37bcbb6 req-8f35bd0a-d2e0-4a2d-8e43-bdcd8c61033f service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:09.876882 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-4795569f-5e4c-4acc-bb02-240ab37bcbb6 req-8f35bd0a-d2e0-4a2d-8e43-bdcd8c61033f service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:09.891880 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-4795569f-5e4c-4acc-bb02-240ab37bcbb6 req-8f35bd0a-d2e0-4a2d-8e43-bdcd8c61033f service nova] Creating event network-changed:b19d4fbb-0cf8-4c5b-b7e2-ad5cd60e8812 for instance a775668d-41e5-407f-ad33-a3b265985d10 on hv-cinder-84773 Jun 27 21:20:09.897588 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-4795569f-5e4c-4acc-bb02-240ab37bcbb6 req-8f35bd0a-d2e0-4a2d-8e43-bdcd8c61033f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034155 Jun 27 21:20:09.898545 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 282/547] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:20:10.603787 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ddf19db4-991a-4199-924c-67350c0be0fa tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:10.604400 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ddf19db4-991a-4199-924c-67350c0be0fa tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:10.611825 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ddf19db4-991a-4199-924c-67350c0be0fa tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:10.612274 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ddf19db4-991a-4199-924c-67350c0be0fa tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:10.613074 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ddf19db4-991a-4199-924c-67350c0be0fa tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:10.613501 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ddf19db4-991a-4199-924c-67350c0be0fa tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:10.763335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ddf19db4-991a-4199-924c-67350c0be0fa tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:10.772962 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ddf19db4-991a-4199-924c-67350c0be0fa tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:10.774583 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ddf19db4-991a-4199-924c-67350c0be0fa tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:10.776100 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ddf19db4-991a-4199-924c-67350c0be0fa tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1404 microversion: 2.20 time: 0.176301 Jun 27 21:20:10.776758 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 266/548] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:10 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1404 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:11.796042 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-31439dbe-701f-42f5-80a2-aa0867ddf118 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:11.796828 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-31439dbe-701f-42f5-80a2-aa0867ddf118 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:11.805535 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-31439dbe-701f-42f5-80a2-aa0867ddf118 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:11.805974 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-31439dbe-701f-42f5-80a2-aa0867ddf118 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:11.807580 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-31439dbe-701f-42f5-80a2-aa0867ddf118 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:11.808019 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-31439dbe-701f-42f5-80a2-aa0867ddf118 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:11.981330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-31439dbe-701f-42f5-80a2-aa0867ddf118 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:11.989905 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-31439dbe-701f-42f5-80a2-aa0867ddf118 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:11.991473 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-31439dbe-701f-42f5-80a2-aa0867ddf118 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:11.992693 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-31439dbe-701f-42f5-80a2-aa0867ddf118 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1404 microversion: 2.20 time: 0.201801 Jun 27 21:20:11.993286 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 283/549] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:11 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1404 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:13.011494 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cbdd916e-b171-48c3-b974-d57278145e57 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:13.012102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cbdd916e-b171-48c3-b974-d57278145e57 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:13.019937 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cbdd916e-b171-48c3-b974-d57278145e57 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:13.019937 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cbdd916e-b171-48c3-b974-d57278145e57 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:13.020261 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cbdd916e-b171-48c3-b974-d57278145e57 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:13.020684 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cbdd916e-b171-48c3-b974-d57278145e57 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:13.159958 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cbdd916e-b171-48c3-b974-d57278145e57 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:13.168649 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cbdd916e-b171-48c3-b974-d57278145e57 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:13.170207 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cbdd916e-b171-48c3-b974-d57278145e57 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:13.171327 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cbdd916e-b171-48c3-b974-d57278145e57 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1404 microversion: 2.20 time: 0.164119 Jun 27 21:20:13.171862 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 267/550] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:13 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:14.190247 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-50443b5a-42c6-4cd8-8a9c-ae1bd9eaa2fb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:14.190855 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-50443b5a-42c6-4cd8-8a9c-ae1bd9eaa2fb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:14.199962 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-50443b5a-42c6-4cd8-8a9c-ae1bd9eaa2fb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:14.200409 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-50443b5a-42c6-4cd8-8a9c-ae1bd9eaa2fb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:14.201239 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-50443b5a-42c6-4cd8-8a9c-ae1bd9eaa2fb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:14.201668 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-50443b5a-42c6-4cd8-8a9c-ae1bd9eaa2fb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:14.346115 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-50443b5a-42c6-4cd8-8a9c-ae1bd9eaa2fb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:14.354793 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-50443b5a-42c6-4cd8-8a9c-ae1bd9eaa2fb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:14.356290 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-50443b5a-42c6-4cd8-8a9c-ae1bd9eaa2fb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:14.357461 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-50443b5a-42c6-4cd8-8a9c-ae1bd9eaa2fb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1404 microversion: 2.20 time: 0.171593 Jun 27 21:20:14.358041 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 284/551] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:14 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1404 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:14.614392 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-82747e2b-8d69-4e4b-b0f9-244ac90ad8ba req-8341cca4-6829-468c-9354-c1cc75e80f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a775668d-41e5-407f-ad33-a3b265985d10", "name": "network-vif-plugged", "status": "completed", "tag": "b19d4fbb-0cf8-4c5b-b7e2-ad5cd60e8812"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:14.625125 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-82747e2b-8d69-4e4b-b0f9-244ac90ad8ba req-8341cca4-6829-468c-9354-c1cc75e80f38 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:14.625625 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-82747e2b-8d69-4e4b-b0f9-244ac90ad8ba req-8341cca4-6829-468c-9354-c1cc75e80f38 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:14.645199 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-82747e2b-8d69-4e4b-b0f9-244ac90ad8ba req-8341cca4-6829-468c-9354-c1cc75e80f38 service nova] Creating event network-vif-plugged:b19d4fbb-0cf8-4c5b-b7e2-ad5cd60e8812 for instance a775668d-41e5-407f-ad33-a3b265985d10 on hv-cinder-84773 Jun 27 21:20:14.651725 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-82747e2b-8d69-4e4b-b0f9-244ac90ad8ba req-8341cca4-6829-468c-9354-c1cc75e80f38 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040944 Jun 27 21:20:14.652340 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 268/552] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:15.091418 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-cb069fad-9b08-43bf-8af0-c095b44c6c8a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:15.092401 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-cb069fad-9b08-43bf-8af0-c095b44c6c8a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:15.099098 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cb069fad-9b08-43bf-8af0-c095b44c6c8a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:15.099568 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cb069fad-9b08-43bf-8af0-c095b44c6c8a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:15.100336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cb069fad-9b08-43bf-8af0-c095b44c6c8a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:15.100771 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cb069fad-9b08-43bf-8af0-c095b44c6c8a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:15.133916 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-cb069fad-9b08-43bf-8af0-c095b44c6c8a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046509 Jun 27 21:20:15.134544 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 285/553] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 27 21:20:15 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 21:20:15.200461 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-006b5054-a071-4e92-ad1c-84c6aaec6bc7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:15.200983 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-006b5054-a071-4e92-ad1c-84c6aaec6bc7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:15.208139 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-006b5054-a071-4e92-ad1c-84c6aaec6bc7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:15.208587 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-006b5054-a071-4e92-ad1c-84c6aaec6bc7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:15.209437 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-006b5054-a071-4e92-ad1c-84c6aaec6bc7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:15.210229 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-006b5054-a071-4e92-ad1c-84c6aaec6bc7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:15.237657 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-006b5054-a071-4e92-ad1c-84c6aaec6bc7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:20:15.317795 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-006b5054-a071-4e92-ad1c-84c6aaec6bc7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "DELETE /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 204 len: 0 microversion: 2.1 time: 0.121270 Jun 27 21:20:15.318478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 269/554] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:20:15 2022] DELETE /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:20:15.327588 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3d4405c2-34f1-4c7f-9290-6cfe1b4a5844 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:15.328255 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3d4405c2-34f1-4c7f-9290-6cfe1b4a5844 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:15.335777 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3d4405c2-34f1-4c7f-9290-6cfe1b4a5844 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:15.336419 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3d4405c2-34f1-4c7f-9290-6cfe1b4a5844 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:15.337180 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3d4405c2-34f1-4c7f-9290-6cfe1b4a5844 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:15.337643 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3d4405c2-34f1-4c7f-9290-6cfe1b4a5844 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:15.376629 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5a147b37-6a8a-475c-ad41-1d81003f17d2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:15.377516 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5a147b37-6a8a-475c-ad41-1d81003f17d2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:15.383481 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5a147b37-6a8a-475c-ad41-1d81003f17d2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:15.383906 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5a147b37-6a8a-475c-ad41-1d81003f17d2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:15.384657 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5a147b37-6a8a-475c-ad41-1d81003f17d2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:15.385623 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5a147b37-6a8a-475c-ad41-1d81003f17d2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:15.476164 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3d4405c2-34f1-4c7f-9290-6cfe1b4a5844 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:15.485221 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3d4405c2-34f1-4c7f-9290-6cfe1b4a5844 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1674 microversion: 2.1 time: 0.161575 Jun 27 21:20:15.485815 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 286/555] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:15 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:15.526116 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5a147b37-6a8a-475c-ad41-1d81003f17d2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:15.534389 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5a147b37-6a8a-475c-ad41-1d81003f17d2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:15.535884 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5a147b37-6a8a-475c-ad41-1d81003f17d2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:15.537007 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5a147b37-6a8a-475c-ad41-1d81003f17d2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1404 microversion: 2.20 time: 0.164694 Jun 27 21:20:15.537568 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 270/556] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:15 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:20:16.504056 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-05429ef6-1e38-45ca-8ff7-4ddadbedd409 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:16.504872 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-05429ef6-1e38-45ca-8ff7-4ddadbedd409 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:16.513542 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-05429ef6-1e38-45ca-8ff7-4ddadbedd409 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:16.514135 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-05429ef6-1e38-45ca-8ff7-4ddadbedd409 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:16.518585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-05429ef6-1e38-45ca-8ff7-4ddadbedd409 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:16.519042 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-05429ef6-1e38-45ca-8ff7-4ddadbedd409 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:16.555307 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4240c2a0-54b8-42ea-aea5-5bee64bf6b3d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:16.555973 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4240c2a0-54b8-42ea-aea5-5bee64bf6b3d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:16.558660 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:16.564966 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4240c2a0-54b8-42ea-aea5-5bee64bf6b3d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:16.564966 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4240c2a0-54b8-42ea-aea5-5bee64bf6b3d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:16.565886 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4240c2a0-54b8-42ea-aea5-5bee64bf6b3d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:16.566323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4240c2a0-54b8-42ea-aea5-5bee64bf6b3d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:16.660112 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-05429ef6-1e38-45ca-8ff7-4ddadbedd409 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:16.667883 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-05429ef6-1e38-45ca-8ff7-4ddadbedd409 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1674 microversion: 2.1 time: 0.167745 Jun 27 21:20:16.668600 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 287/557] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:16 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:16.703240 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4240c2a0-54b8-42ea-aea5-5bee64bf6b3d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:16.711633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4240c2a0-54b8-42ea-aea5-5bee64bf6b3d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:16.713265 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4240c2a0-54b8-42ea-aea5-5bee64bf6b3d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:16.714353 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4240c2a0-54b8-42ea-aea5-5bee64bf6b3d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1404 microversion: 2.20 time: 0.163040 Jun 27 21:20:16.714925 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 271/558] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:16 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:17.682674 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:17.683460 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=6 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:17.688185 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-699cf2f4-d521-4fc4-8a61-ab411aea1eb7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:17.688827 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-699cf2f4-d521-4fc4-8a61-ab411aea1eb7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:17.695869 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-699cf2f4-d521-4fc4-8a61-ab411aea1eb7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:17.696315 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-699cf2f4-d521-4fc4-8a61-ab411aea1eb7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:17.697109 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-699cf2f4-d521-4fc4-8a61-ab411aea1eb7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:17.697678 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-699cf2f4-d521-4fc4-8a61-ab411aea1eb7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:17.731723 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cc62ead3-5c9c-477b-aa7d-66fbec7c38a1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:17.732319 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cc62ead3-5c9c-477b-aa7d-66fbec7c38a1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:17.734225 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:17.740488 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cc62ead3-5c9c-477b-aa7d-66fbec7c38a1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:17.740962 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cc62ead3-5c9c-477b-aa7d-66fbec7c38a1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:17.741754 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cc62ead3-5c9c-477b-aa7d-66fbec7c38a1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:17.742188 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cc62ead3-5c9c-477b-aa7d-66fbec7c38a1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:17.834026 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-699cf2f4-d521-4fc4-8a61-ab411aea1eb7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:17.843064 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-699cf2f4-d521-4fc4-8a61-ab411aea1eb7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1674 microversion: 2.1 time: 0.161336 Jun 27 21:20:17.843959 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 288/559] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:17 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:17.880423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cc62ead3-5c9c-477b-aa7d-66fbec7c38a1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:17.889164 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cc62ead3-5c9c-477b-aa7d-66fbec7c38a1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:17.890709 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cc62ead3-5c9c-477b-aa7d-66fbec7c38a1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:17.891822 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cc62ead3-5c9c-477b-aa7d-66fbec7c38a1 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1404 microversion: 2.20 time: 0.164019 Jun 27 21:20:17.892498 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 272/560] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:17 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:18.859893 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8cdaa005-efbc-4867-adb5-8ca1f2851d0b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:18.860491 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-8cdaa005-efbc-4867-adb5-8ca1f2851d0b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:18.867337 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8cdaa005-efbc-4867-adb5-8ca1f2851d0b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:18.867783 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8cdaa005-efbc-4867-adb5-8ca1f2851d0b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:18.868543 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8cdaa005-efbc-4867-adb5-8ca1f2851d0b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:18.869475 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8cdaa005-efbc-4867-adb5-8ca1f2851d0b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:18.910476 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-be336c15-5d23-40c9-a926-9b81b772fbf5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:18.911084 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-be336c15-5d23-40c9-a926-9b81b772fbf5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:18.919047 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-be336c15-5d23-40c9-a926-9b81b772fbf5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:18.919613 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-be336c15-5d23-40c9-a926-9b81b772fbf5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:18.920409 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-be336c15-5d23-40c9-a926-9b81b772fbf5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:18.921098 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-be336c15-5d23-40c9-a926-9b81b772fbf5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:19.007852 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8cdaa005-efbc-4867-adb5-8ca1f2851d0b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:19.012069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:19.016700 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8cdaa005-efbc-4867-adb5-8ca1f2851d0b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1674 microversion: 2.1 time: 0.160674 Jun 27 21:20:19.021455 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 289/561] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:18 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:19.151283 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-be336c15-5d23-40c9-a926-9b81b772fbf5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:19.161643 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-be336c15-5d23-40c9-a926-9b81b772fbf5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:19.163134 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-be336c15-5d23-40c9-a926-9b81b772fbf5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:19.164307 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-be336c15-5d23-40c9-a926-9b81b772fbf5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1596 microversion: 2.20 time: 0.257774 Jun 27 21:20:19.164858 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 273/562] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:18 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1596 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:20:19.182416 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7f63a77d-259a-416f-bbf4-5aaf438fccda tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:19.183217 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7f63a77d-259a-416f-bbf4-5aaf438fccda tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:19.190075 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7f63a77d-259a-416f-bbf4-5aaf438fccda tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:19.190656 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7f63a77d-259a-416f-bbf4-5aaf438fccda tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:19.191483 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7f63a77d-259a-416f-bbf4-5aaf438fccda tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:19.191906 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7f63a77d-259a-416f-bbf4-5aaf438fccda tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:19.274906 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7f63a77d-259a-416f-bbf4-5aaf438fccda tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096909 Jun 27 21:20:19.275855 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 290/563] 10.222.0.13 () {60 vars in 1315 bytes} [Mon Jun 27 21:20:19 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:20:19.632209 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-1b9cd4d7-ce5b-441a-b51c-c9bd7796dec1 req-9b7387c9-f64e-478b-8c5e-3ab2cb27317f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "977f8cd5-d96e-4a13-b043-405e5c4325f1", "name": "network-vif-deleted", "tag": "f88b5f5e-d7cd-4400-8ce9-9cede29542e2"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:19.641297 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-1b9cd4d7-ce5b-441a-b51c-c9bd7796dec1 req-9b7387c9-f64e-478b-8c5e-3ab2cb27317f service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:19.641805 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-1b9cd4d7-ce5b-441a-b51c-c9bd7796dec1 req-9b7387c9-f64e-478b-8c5e-3ab2cb27317f service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:19.654931 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-1b9cd4d7-ce5b-441a-b51c-c9bd7796dec1 req-9b7387c9-f64e-478b-8c5e-3ab2cb27317f service nova] Creating event network-vif-deleted:f88b5f5e-d7cd-4400-8ce9-9cede29542e2 for instance 977f8cd5-d96e-4a13-b043-405e5c4325f1 on hv-cinder-84773 Jun 27 21:20:19.661040 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-1b9cd4d7-ce5b-441a-b51c-c9bd7796dec1 req-9b7387c9-f64e-478b-8c5e-3ab2cb27317f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032486 Jun 27 21:20:19.662260 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 274/564] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:20.035444 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c60ee930-d933-4cc2-b95c-24101f7b7627 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:20.036720 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c60ee930-d933-4cc2-b95c-24101f7b7627 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:20.044162 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c60ee930-d933-4cc2-b95c-24101f7b7627 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:20.044915 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c60ee930-d933-4cc2-b95c-24101f7b7627 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:20.045795 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c60ee930-d933-4cc2-b95c-24101f7b7627 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:20.046219 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c60ee930-d933-4cc2-b95c-24101f7b7627 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:20.081109 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c60ee930-d933-4cc2-b95c-24101f7b7627 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:20.081542 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c60ee930-d933-4cc2-b95c-24101f7b7627 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:20.082231 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-c60ee930-d933-4cc2-b95c-24101f7b7627 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lazy-loading 'fault' on Instance uuid 977f8cd5-d96e-4a13-b043-405e5c4325f1 {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:20:20.162754 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c60ee930-d933-4cc2-b95c-24101f7b7627 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:20.173647 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c60ee930-d933-4cc2-b95c-24101f7b7627 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 200 len: 1328 microversion: 2.1 time: 0.142061 Jun 27 21:20:20.174525 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 291/565] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:20 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 1328 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:20.661114 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-4e03cfa4-dfb9-4ebd-91b4-1f47a36aa11e req-5b2bf3b4-14f8-40a9-a10f-7f1ffe402f08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a775668d-41e5-407f-ad33-a3b265985d10", "tag": "b19d4fbb-0cf8-4c5b-b7e2-ad5cd60e8812"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:20.670997 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-4e03cfa4-dfb9-4ebd-91b4-1f47a36aa11e req-5b2bf3b4-14f8-40a9-a10f-7f1ffe402f08 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:20.672145 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-4e03cfa4-dfb9-4ebd-91b4-1f47a36aa11e req-5b2bf3b4-14f8-40a9-a10f-7f1ffe402f08 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:20.687139 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-4e03cfa4-dfb9-4ebd-91b4-1f47a36aa11e req-5b2bf3b4-14f8-40a9-a10f-7f1ffe402f08 service nova] Creating event network-changed:b19d4fbb-0cf8-4c5b-b7e2-ad5cd60e8812 for instance a775668d-41e5-407f-ad33-a3b265985d10 on hv-cinder-84773 Jun 27 21:20:20.694512 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-4e03cfa4-dfb9-4ebd-91b4-1f47a36aa11e req-5b2bf3b4-14f8-40a9-a10f-7f1ffe402f08 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038069 Jun 27 21:20:20.695137 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 275/566] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:21.191807 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-92db9186-df26-4c11-9cc8-149d7a31e171 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:21.192486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-92db9186-df26-4c11-9cc8-149d7a31e171 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:21.199413 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-92db9186-df26-4c11-9cc8-149d7a31e171 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:21.199865 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-92db9186-df26-4c11-9cc8-149d7a31e171 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:21.200869 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-92db9186-df26-4c11-9cc8-149d7a31e171 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:21.201334 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-92db9186-df26-4c11-9cc8-149d7a31e171 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:21.216218 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-92db9186-df26-4c11-9cc8-149d7a31e171 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] HTTP exception thrown: Instance 977f8cd5-d96e-4a13-b043-405e5c4325f1 could not be found. Jun 27 21:20:21.217918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-92db9186-df26-4c11-9cc8-149d7a31e171 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Request method failure captured: Jun 27 21:20:21.217918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 HTTP/1.1 Jun 27 21:20:21.217918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:20:21.217918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:20:21.217918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:20:21.217918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:20:21.217918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:20:21.217918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:20:21.217918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:20:21.217918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:20:21.217918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh4VXSvuHVVsVV18DxuCD-1hraSB5lRr2lXGIdjQidFORkIKGXdco8C-CEtj8eV3_hS4IoSB0251skpQY6CgNWafIyRQzVdmoCbZuwzuZJMnrk657v_0p6Qxh-yoz5yhBpt92zaTu8q_575oy3TNlVx3PuQHs9OLBF-opQuTV9AFfXY Jun 27 21:20:21.217918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:20:21.217918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:20:21.217918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:20:21.217918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:20:21.217918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:20:21.217918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:20:21.217918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: d8c1bcb797ba4eb0ad6daf5ed39baa89 Jun 27 21:20:21.217918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-AttachVolumeTestJSON-971813324 Jun 27 21:20:21.217918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:20:21.217918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:20:21.219617 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d8c1bcb797ba4eb0ad6daf5ed39baa89", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d8c1bcb797ba4eb0ad6daf5ed39baa89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d8c1bcb797ba4eb0ad6daf5ed39baa89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d8c1bcb797ba4eb0ad6daf5ed39baa89"}]}] Jun 27 21:20:21.219617 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-AttachVolumeTestJSON-971813324 Jun 27 21:20:21.219617 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: d8c1bcb797ba4eb0ad6daf5ed39baa89 Jun 27 21:20:21.219617 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-AttachVolumeTestJSON-971813324 Jun 27 21:20:21.219617 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-AttachVolumeTestJSON-971813324-project Jun 27 21:20:21.219617 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:20:21.219617 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:20:21.219617 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: 7969c6620a0d406890fb4c15b58ab349 Jun 27 21:20:21.219617 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-AttachVolumeTestJSON-971813324-project Jun 27 21:20:21.219617 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: > Jun 27 21:20:21.219617 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Instance 977f8cd5-d96e-4a13-b043-405e5c4325f1 could not be found. Jun 27 21:20:21.219617 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'id': '977f8cd5-d96e-4a13-b043-405e5c4325f1'} Jun 27 21:20:21.224090 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:20:21.224090 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:21.224090 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:20:21.224090 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:20:21.224090 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:20:21.224090 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:20:21.224090 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:20:21.224090 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:20:21.224090 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:20:21.224090 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:20:21.224090 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 977f8cd5-d96e-4a13-b043-405e5c4325f1 could not be found. Jun 27 21:20:21.224090 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:20:21.224090 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:20:21.224090 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:20:21.224090 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:21.224090 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:20:21.224090 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:20:21.224090 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:20:21.224090 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:20:21.224090 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:20:21.225590 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:20:21.225590 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:20:21.225590 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:20:21.225590 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:20:21.225590 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:20:21.225590 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:20:21.225590 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:20:21.225590 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 977f8cd5-d96e-4a13-b043-405e5c4325f1 could not be found. Jun 27 21:20:21.225590 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:20:21.225590 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:20:21.225590 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:20:21.225590 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:21.225590 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:20:21.225590 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:20:21.225590 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:20:21.225590 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:20:21.225590 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 977f8cd5-d96e-4a13-b043-405e5c4325f1 could not be found. Jun 27 21:20:21.225590 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:20:21.226860 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-92db9186-df26-4c11-9cc8-149d7a31e171 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Returning 404 to user: Instance 977f8cd5-d96e-4a13-b043-405e5c4325f1 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:20:21.226860 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-92db9186-df26-4c11-9cc8-149d7a31e171 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 404 len: 111 microversion: 2.1 time: 0.031702 Jun 27 21:20:21.226860 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 292/567] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:21 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:20:21.229200 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ba9aebb5-7d0e-40b6-9a12-fad3fb189186 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '.version_select at 0x7f835428a5e0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:21.248393 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ba9aebb5-7d0e-40b6-9a12-fad3fb189186 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1944278523" status: 202 len: 0 microversion: 2.1 time: 0.023345 Jun 27 21:20:21.249018 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 276/568] 10.222.0.13 () {58 vars in 1220 bytes} [Mon Jun 27 21:20:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1944278523 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:20:21.908377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1c225946-8633-4dd5-ba96-1eca2b0c5122 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Action: 'create', calling method: .version_select at 0x7f834f2235e0>, body: {"keypair": {"name": "tempest-keypair-473998399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLsWHJSL3wwWxI0HR6hBRARoEk8uLA/ec8hk1zME0DWGkujlnAOunzJWny7zIV3brjlvbshlPboz14VAeIns+NlL0+oGmhhnQBdh3oKjIf2HaZ25KEMc5TQD/3wqYtZng=="}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:21.923339 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-1c225946-8633-4dd5-ba96-1eca2b0c5122 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Getting quotas for project d8c1bcb797ba4eb0ad6daf5ed39baa89. Resources: {'key_pairs'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:20:21.927396 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-1c225946-8633-4dd5-ba96-1eca2b0c5122 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Getting quotas for user 7969c6620a0d406890fb4c15b58ab349 and project d8c1bcb797ba4eb0ad6daf5ed39baa89. Resources: {'key_pairs'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:20:21.951647 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1c225946-8633-4dd5-ba96-1eca2b0c5122 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053627 Jun 27 21:20:21.952242 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 293/569] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 27 21:20:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:23.220248 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d9d907e3-f8b6-4405-a35b-7a63cf4e77fe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-554889947", "imageRef": "3155f228-b1ff-487e-837f-85eec68c250a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ab36d48-170c-4f48-af11-d6da9c4061e0"}], "security_groups": [{"name": "tempest-securitygroup--1868370097"}], "key_name": "tempest-keypair-473998399", "user_data": "}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:23.328383 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-d9d907e3-f8b6-4405-a35b-7a63cf4e77fe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] validate_networks() for [('1ab36d48-170c-4f48-af11-d6da9c4061e0', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:20:23.979462 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-d9d907e3-f8b6-4405-a35b-7a63cf4e77fe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:20:23.979879 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-d9d907e3-f8b6-4405-a35b-7a63cf4e77fe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:20:23.980340 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-d9d907e3-f8b6-4405-a35b-7a63cf4e77fe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:20:23.980776 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-d9d907e3-f8b6-4405-a35b-7a63cf4e77fe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:20:23.981201 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-d9d907e3-f8b6-4405-a35b-7a63cf4e77fe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:20:23.991563 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d9d907e3-f8b6-4405-a35b-7a63cf4e77fe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:23.992031 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d9d907e3-f8b6-4405-a35b-7a63cf4e77fe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:23.992854 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d9d907e3-f8b6-4405-a35b-7a63cf4e77fe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:23.993318 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d9d907e3-f8b6-4405-a35b-7a63cf4e77fe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:24.011709 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-d9d907e3-f8b6-4405-a35b-7a63cf4e77fe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Getting quotas for project d8c1bcb797ba4eb0ad6daf5ed39baa89. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:20:24.016104 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-d9d907e3-f8b6-4405-a35b-7a63cf4e77fe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Getting quotas for user 7969c6620a0d406890fb4c15b58ab349 and project d8c1bcb797ba4eb0ad6daf5ed39baa89. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:20:24.028910 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d9d907e3-f8b6-4405-a35b-7a63cf4e77fe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:20:24.031359 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d9d907e3-f8b6-4405-a35b-7a63cf4e77fe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3155f228-b1ff-487e-837f-85eec68c250a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:20:24.081236 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d9d907e3-f8b6-4405-a35b-7a63cf4e77fe tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.865744 Jun 27 21:20:24.081897 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 277/570] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 27 21:20:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:20:24.093094 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-629f264a-8b2e-482e-99f0-487052443a3c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:24.093816 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-629f264a-8b2e-482e-99f0-487052443a3c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:24.149379 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-629f264a-8b2e-482e-99f0-487052443a3c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:24.158133 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-629f264a-8b2e-482e-99f0-487052443a3c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5" status: 200 len: 1236 microversion: 2.1 time: 0.069459 Jun 27 21:20:24.158819 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 294/571] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:24 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 => generated 1236 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:25.177463 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c0fbe7e8-7170-4679-b30c-b51ae73dce3a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:25.178222 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c0fbe7e8-7170-4679-b30c-b51ae73dce3a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:25.187199 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c0fbe7e8-7170-4679-b30c-b51ae73dce3a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:25.187651 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c0fbe7e8-7170-4679-b30c-b51ae73dce3a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:25.188440 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c0fbe7e8-7170-4679-b30c-b51ae73dce3a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:25.188878 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c0fbe7e8-7170-4679-b30c-b51ae73dce3a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:25.265861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c0fbe7e8-7170-4679-b30c-b51ae73dce3a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:25.276743 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c0fbe7e8-7170-4679-b30c-b51ae73dce3a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5" status: 200 len: 1288 microversion: 2.1 time: 0.104269 Jun 27 21:20:25.277188 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 278/572] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:25 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 => generated 1288 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:26.151093 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6a526dc0-5f09-46a8-b300-5e2e4d7a781e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:26.151696 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6a526dc0-5f09-46a8-b300-5e2e4d7a781e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:26.158670 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6a526dc0-5f09-46a8-b300-5e2e4d7a781e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:26.159108 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6a526dc0-5f09-46a8-b300-5e2e4d7a781e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:26.162137 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6a526dc0-5f09-46a8-b300-5e2e4d7a781e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:26.162137 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6a526dc0-5f09-46a8-b300-5e2e4d7a781e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:26.284695 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-6a526dc0-5f09-46a8-b300-5e2e4d7a781e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lazy-loading 'services' on Instance uuid 3a1409c2-ecfa-4ed4-b547-aa5667367e5d {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:20:26.300711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8a5776e6-aeb1-4185-897e-ece1a04f93e7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:26.301820 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8a5776e6-aeb1-4185-897e-ece1a04f93e7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:26.315892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8a5776e6-aeb1-4185-897e-ece1a04f93e7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:26.316695 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8a5776e6-aeb1-4185-897e-ece1a04f93e7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:26.318432 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8a5776e6-aeb1-4185-897e-ece1a04f93e7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:26.319661 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8a5776e6-aeb1-4185-897e-ece1a04f93e7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:26.406158 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6a526dc0-5f09-46a8-b300-5e2e4d7a781e tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d/os-volume_attachments/be27b8ca-3335-4629-8b9d-c8fea9780a2b" status: 202 len: 0 microversion: 2.1 time: 0.260645 Jun 27 21:20:26.410371 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 295/573] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 27 21:20:26 2022] DELETE /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d/os-volume_attachments/be27b8ca-3335-4629-8b9d-c8fea9780a2b => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:20:26.422611 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-732e96b1-99fa-49d0-bed4-65c17f966a8b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:26.425221 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-732e96b1-99fa-49d0-bed4-65c17f966a8b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:26.435193 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-732e96b1-99fa-49d0-bed4-65c17f966a8b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:26.435645 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-732e96b1-99fa-49d0-bed4-65c17f966a8b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:26.436407 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-732e96b1-99fa-49d0-bed4-65c17f966a8b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:26.437152 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-732e96b1-99fa-49d0-bed4-65c17f966a8b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:26.477507 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-732e96b1-99fa-49d0-bed4-65c17f966a8b tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063452 Jun 27 21:20:26.479221 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 296/574] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 27 21:20:26 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:26.555668 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8a5776e6-aeb1-4185-897e-ece1a04f93e7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:26.565342 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8a5776e6-aeb1-4185-897e-ece1a04f93e7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5" status: 200 len: 1362 microversion: 2.1 time: 0.270331 Jun 27 21:20:26.566041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 279/575] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:26 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:27.151342 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-f5f2f286-4cf7-432b-979a-e1d9391f760e req-11f6f823-d986-4663-90c6-a9c91bc484dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "624274f6-859f-4e03-9c00-90574d06b2c5", "tag": "67ccd3c5-1cc9-425f-a7e3-26606e621d54"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:27.173583 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-f5f2f286-4cf7-432b-979a-e1d9391f760e req-11f6f823-d986-4663-90c6-a9c91bc484dd service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:27.174044 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-f5f2f286-4cf7-432b-979a-e1d9391f760e req-11f6f823-d986-4663-90c6-a9c91bc484dd service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:27.195628 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-f5f2f286-4cf7-432b-979a-e1d9391f760e req-11f6f823-d986-4663-90c6-a9c91bc484dd service nova] Creating event network-changed:67ccd3c5-1cc9-425f-a7e3-26606e621d54 for instance 624274f6-859f-4e03-9c00-90574d06b2c5 on hv-cinder-84773 Jun 27 21:20:27.201078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-f5f2f286-4cf7-432b-979a-e1d9391f760e req-11f6f823-d986-4663-90c6-a9c91bc484dd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055062 Jun 27 21:20:27.201709 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 297/576] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:27.490437 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ae84de85-c2e2-423b-b206-23ef642f5852 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:27.491490 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ae84de85-c2e2-423b-b206-23ef642f5852 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:27.500199 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae84de85-c2e2-423b-b206-23ef642f5852 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:27.500728 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae84de85-c2e2-423b-b206-23ef642f5852 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:27.501583 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae84de85-c2e2-423b-b206-23ef642f5852 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:27.502026 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae84de85-c2e2-423b-b206-23ef642f5852 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:27.538443 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ae84de85-c2e2-423b-b206-23ef642f5852 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052065 Jun 27 21:20:27.538933 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 280/577] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 27 21:20:27 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 21:20:27.581812 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e77145cb-f958-4eda-a3a4-3ef1588418ce tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:27.582611 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e77145cb-f958-4eda-a3a4-3ef1588418ce tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:27.592338 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e77145cb-f958-4eda-a3a4-3ef1588418ce tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:27.593036 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-769630e4-7a1b-4e85-9e79-3a6a420c3f31 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:27.593344 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e77145cb-f958-4eda-a3a4-3ef1588418ce tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:27.593877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-769630e4-7a1b-4e85-9e79-3a6a420c3f31 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:27.594534 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e77145cb-f958-4eda-a3a4-3ef1588418ce tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:27.595203 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e77145cb-f958-4eda-a3a4-3ef1588418ce tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:27.614907 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-769630e4-7a1b-4e85-9e79-3a6a420c3f31 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:27.615432 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-769630e4-7a1b-4e85-9e79-3a6a420c3f31 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:27.617518 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-769630e4-7a1b-4e85-9e79-3a6a420c3f31 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:27.618553 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-769630e4-7a1b-4e85-9e79-3a6a420c3f31 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:27.633410 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e77145cb-f958-4eda-a3a4-3ef1588418ce tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9/ips" status: 200 len: 149 microversion: 2.1 time: 0.058809 Jun 27 21:20:27.634483 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 298/578] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 27 21:20:27 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9/ips => generated 149 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:27.639364 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b6a075f2-4ca4-45fa-96ba-845df1ada175 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:27.639856 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b6a075f2-4ca4-45fa-96ba-845df1ada175 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:27.647400 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b6a075f2-4ca4-45fa-96ba-845df1ada175 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:27.647847 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b6a075f2-4ca4-45fa-96ba-845df1ada175 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:27.648624 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b6a075f2-4ca4-45fa-96ba-845df1ada175 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:27.649098 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b6a075f2-4ca4-45fa-96ba-845df1ada175 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:27.684115 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b6a075f2-4ca4-45fa-96ba-845df1ada175 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Going to try to terminate instance {{(pid=117891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:20:27.786206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b6a075f2-4ca4-45fa-96ba-845df1ada175 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 204 len: 0 microversion: 2.1 time: 0.149859 Jun 27 21:20:27.787246 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 299/579] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:20:27 2022] DELETE /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:20:27.799177 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-299e9df4-476f-47b9-ae64-f35ca8ce03f5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:27.800468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-299e9df4-476f-47b9-ae64-f35ca8ce03f5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:27.808100 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-299e9df4-476f-47b9-ae64-f35ca8ce03f5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:27.808547 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-299e9df4-476f-47b9-ae64-f35ca8ce03f5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:27.809369 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-299e9df4-476f-47b9-ae64-f35ca8ce03f5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:27.809982 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-299e9df4-476f-47b9-ae64-f35ca8ce03f5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:27.898067 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-769630e4-7a1b-4e85-9e79-3a6a420c3f31 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:27.910001 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-769630e4-7a1b-4e85-9e79-3a6a420c3f31 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5" status: 200 len: 1362 microversion: 2.1 time: 0.322408 Jun 27 21:20:27.910740 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 281/580] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:27 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 => generated 1362 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:20:27.998746 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-299e9df4-476f-47b9-ae64-f35ca8ce03f5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:28.008360 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-299e9df4-476f-47b9-ae64-f35ca8ce03f5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1689 microversion: 2.1 time: 0.213370 Jun 27 21:20:28.024528 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 300/581] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:27 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1689 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:28.928624 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bfb7f9af-0df5-4b12-b721-9c715c0accff tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:28.929336 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bfb7f9af-0df5-4b12-b721-9c715c0accff tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:28.936836 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bfb7f9af-0df5-4b12-b721-9c715c0accff tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:28.937472 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bfb7f9af-0df5-4b12-b721-9c715c0accff tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:28.938396 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bfb7f9af-0df5-4b12-b721-9c715c0accff tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:28.938932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bfb7f9af-0df5-4b12-b721-9c715c0accff tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:29.027488 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0769d54e-7d00-4c09-a4f1-0517894f6b80 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:29.028613 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0769d54e-7d00-4c09-a4f1-0517894f6b80 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:29.038126 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0769d54e-7d00-4c09-a4f1-0517894f6b80 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:29.038625 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0769d54e-7d00-4c09-a4f1-0517894f6b80 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:29.039339 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0769d54e-7d00-4c09-a4f1-0517894f6b80 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:29.039757 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0769d54e-7d00-4c09-a4f1-0517894f6b80 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:29.099133 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bfb7f9af-0df5-4b12-b721-9c715c0accff tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:29.103240 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:29.111514 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bfb7f9af-0df5-4b12-b721-9c715c0accff tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5" status: 200 len: 1362 microversion: 2.1 time: 0.186321 Jun 27 21:20:29.112472 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 282/582] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:28 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:29.117845 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4a769f0d-cbf6-406f-b5b8-66ef707880ce tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d062021-72d2-4884-98c7-3d46bdb1128d"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:29.119235 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4a769f0d-cbf6-406f-b5b8-66ef707880ce tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:29.127217 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a769f0d-cbf6-406f-b5b8-66ef707880ce tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:29.128306 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a769f0d-cbf6-406f-b5b8-66ef707880ce tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:29.129589 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a769f0d-cbf6-406f-b5b8-66ef707880ce tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:29.129805 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a769f0d-cbf6-406f-b5b8-66ef707880ce tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:29.185971 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0769d54e-7d00-4c09-a4f1-0517894f6b80 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:29.194617 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0769d54e-7d00-4c09-a4f1-0517894f6b80 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1689 microversion: 2.1 time: 0.174009 Jun 27 21:20:29.195259 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 301/583] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:29 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:30.133171 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d614ec60-d812-4bc0-9d92-b1c36d3435e0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:30.133904 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d614ec60-d812-4bc0-9d92-b1c36d3435e0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:30.141093 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d614ec60-d812-4bc0-9d92-b1c36d3435e0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:30.141544 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d614ec60-d812-4bc0-9d92-b1c36d3435e0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:30.142317 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d614ec60-d812-4bc0-9d92-b1c36d3435e0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:30.142750 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d614ec60-d812-4bc0-9d92-b1c36d3435e0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:30.284015 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d614ec60-d812-4bc0-9d92-b1c36d3435e0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:30.291885 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d614ec60-d812-4bc0-9d92-b1c36d3435e0 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5" status: 200 len: 1362 microversion: 2.1 time: 0.162670 Jun 27 21:20:30.292468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 302/584] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:30 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:30.297888 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2a4b277b-0437-4a34-a383-e594b67cf14c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:30.298507 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2a4b277b-0437-4a34-a383-e594b67cf14c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:30.304776 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2a4b277b-0437-4a34-a383-e594b67cf14c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:30.305300 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2a4b277b-0437-4a34-a383-e594b67cf14c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:30.306174 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2a4b277b-0437-4a34-a383-e594b67cf14c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:30.306597 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2a4b277b-0437-4a34-a383-e594b67cf14c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:30.464233 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2a4b277b-0437-4a34-a383-e594b67cf14c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:30.477046 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2a4b277b-0437-4a34-a383-e594b67cf14c tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1689 microversion: 2.1 time: 0.183177 Jun 27 21:20:30.478812 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 303/585] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:30 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:31.309640 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-687beebf-a1d6-4917-ac8e-9a97fef290a8 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:31.310348 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-687beebf-a1d6-4917-ac8e-9a97fef290a8 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:31.312838 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:31.319118 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-687beebf-a1d6-4917-ac8e-9a97fef290a8 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:31.319576 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-687beebf-a1d6-4917-ac8e-9a97fef290a8 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:31.320374 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-687beebf-a1d6-4917-ac8e-9a97fef290a8 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:31.320838 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-687beebf-a1d6-4917-ac8e-9a97fef290a8 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:31.463567 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-687beebf-a1d6-4917-ac8e-9a97fef290a8 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:31.471630 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-687beebf-a1d6-4917-ac8e-9a97fef290a8 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5" status: 200 len: 1362 microversion: 2.1 time: 0.165836 Jun 27 21:20:31.472032 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 304/586] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:31 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:31.495000 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-38d80e03-589d-4723-97fd-e625dd3970ec tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:31.495603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-38d80e03-589d-4723-97fd-e625dd3970ec tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:31.502251 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-38d80e03-589d-4723-97fd-e625dd3970ec tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:31.502702 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-38d80e03-589d-4723-97fd-e625dd3970ec tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:31.503484 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-38d80e03-589d-4723-97fd-e625dd3970ec tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:31.503917 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-38d80e03-589d-4723-97fd-e625dd3970ec tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:31.644248 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-38d80e03-589d-4723-97fd-e625dd3970ec tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:31.652533 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-38d80e03-589d-4723-97fd-e625dd3970ec tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1689 microversion: 2.1 time: 0.161411 Jun 27 21:20:31.653144 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 305/587] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:31 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:32.489681 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6eafd9fe-fde7-4913-86cb-28f7f360aa36 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:32.490468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6eafd9fe-fde7-4913-86cb-28f7f360aa36 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:32.498325 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6eafd9fe-fde7-4913-86cb-28f7f360aa36 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:32.498780 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6eafd9fe-fde7-4913-86cb-28f7f360aa36 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:32.499761 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6eafd9fe-fde7-4913-86cb-28f7f360aa36 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:32.500214 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6eafd9fe-fde7-4913-86cb-28f7f360aa36 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:32.644281 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-6eafd9fe-fde7-4913-86cb-28f7f360aa36 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:32.653352 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6eafd9fe-fde7-4913-86cb-28f7f360aa36 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5" status: 200 len: 1362 microversion: 2.1 time: 0.168146 Jun 27 21:20:32.653951 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 306/588] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:32 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:32.669279 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6fd27046-4f1f-4220-bb0a-3ff28e0df1e3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:32.669992 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6fd27046-4f1f-4220-bb0a-3ff28e0df1e3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:32.678903 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6fd27046-4f1f-4220-bb0a-3ff28e0df1e3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:32.679702 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6fd27046-4f1f-4220-bb0a-3ff28e0df1e3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:32.681190 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6fd27046-4f1f-4220-bb0a-3ff28e0df1e3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:32.681980 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6fd27046-4f1f-4220-bb0a-3ff28e0df1e3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:32.717553 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4a769f0d-cbf6-406f-b5b8-66ef707880ce tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "POST /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.603733 Jun 27 21:20:32.718845 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 283/589] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 27 21:20:29 2022] POST /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9/os-volume_attachments => generated 194 bytes in 3606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:32.859315 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-6fd27046-4f1f-4220-bb0a-3ff28e0df1e3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:32.861720 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:32.869895 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6fd27046-4f1f-4220-bb0a-3ff28e0df1e3 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1689 microversion: 2.1 time: 0.204268 Jun 27 21:20:32.870553 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 307/590] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:32 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1689 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:20:33.673145 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-54cb7019-3f9a-46c1-82c7-55652fab7bb4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:33.673899 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-54cb7019-3f9a-46c1-82c7-55652fab7bb4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:33.683439 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54cb7019-3f9a-46c1-82c7-55652fab7bb4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:33.683889 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54cb7019-3f9a-46c1-82c7-55652fab7bb4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:33.684698 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54cb7019-3f9a-46c1-82c7-55652fab7bb4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:33.685168 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54cb7019-3f9a-46c1-82c7-55652fab7bb4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:33.888364 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a005dbee-9a66-4274-b3d4-f2b5a7fb3196 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:33.889170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a005dbee-9a66-4274-b3d4-f2b5a7fb3196 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:33.896576 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a005dbee-9a66-4274-b3d4-f2b5a7fb3196 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:33.897186 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a005dbee-9a66-4274-b3d4-f2b5a7fb3196 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:33.898001 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a005dbee-9a66-4274-b3d4-f2b5a7fb3196 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:33.898434 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a005dbee-9a66-4274-b3d4-f2b5a7fb3196 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:33.912908 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-54cb7019-3f9a-46c1-82c7-55652fab7bb4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:33.922594 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-54cb7019-3f9a-46c1-82c7-55652fab7bb4 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5" status: 200 len: 1362 microversion: 2.1 time: 0.254703 Jun 27 21:20:33.923448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 284/591] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:33 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:20:33.982171 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a005dbee-9a66-4274-b3d4-f2b5a7fb3196 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:33.990129 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a005dbee-9a66-4274-b3d4-f2b5a7fb3196 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 200 len: 1622 microversion: 2.1 time: 0.107537 Jun 27 21:20:33.990750 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 308/592] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:33 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 1622 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:34.098905 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-b0fd722b-c8f1-4ab7-90b3-d9551245fad6 req-5ff43f7f-820a-4666-b172-374d954ffe55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a1409c2-ecfa-4ed4-b547-aa5667367e5d", "name": "network-vif-deleted", "tag": "b9348a43-0456-47cf-97ba-a8ab01ba6107"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:34.107130 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:34.107938 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:34.115974 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-b0fd722b-c8f1-4ab7-90b3-d9551245fad6 req-5ff43f7f-820a-4666-b172-374d954ffe55 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:34.117120 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-b0fd722b-c8f1-4ab7-90b3-d9551245fad6 req-5ff43f7f-820a-4666-b172-374d954ffe55 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:34.131076 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-b0fd722b-c8f1-4ab7-90b3-d9551245fad6 req-5ff43f7f-820a-4666-b172-374d954ffe55 service nova] Creating event network-vif-deleted:b9348a43-0456-47cf-97ba-a8ab01ba6107 for instance 3a1409c2-ecfa-4ed4-b547-aa5667367e5d on hv-cinder-84773 Jun 27 21:20:34.138420 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-b0fd722b-c8f1-4ab7-90b3-d9551245fad6 req-5ff43f7f-820a-4666-b172-374d954ffe55 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043068 Jun 27 21:20:34.139342 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 285/593] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:34.939937 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-385f5378-578a-43e0-b0be-594a27b37a99 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:34.940618 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-385f5378-578a-43e0-b0be-594a27b37a99 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:34.942669 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=6 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:34.949659 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-385f5378-578a-43e0-b0be-594a27b37a99 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:34.950101 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-385f5378-578a-43e0-b0be-594a27b37a99 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:34.950874 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-385f5378-578a-43e0-b0be-594a27b37a99 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:34.951295 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-385f5378-578a-43e0-b0be-594a27b37a99 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:35.011842 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4d4c4589-ecba-4300-9763-e9a87a377cd5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:35.017988 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4d4c4589-ecba-4300-9763-e9a87a377cd5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 3a1409c2-ecfa-4ed4-b547-aa5667367e5d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:35.031436 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d4c4589-ecba-4300-9763-e9a87a377cd5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:35.031862 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d4c4589-ecba-4300-9763-e9a87a377cd5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:35.032656 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d4c4589-ecba-4300-9763-e9a87a377cd5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:35.033605 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d4c4589-ecba-4300-9763-e9a87a377cd5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:35.048621 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-4d4c4589-ecba-4300-9763-e9a87a377cd5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] HTTP exception thrown: Instance 3a1409c2-ecfa-4ed4-b547-aa5667367e5d could not be found. Jun 27 21:20:35.050337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4d4c4589-ecba-4300-9763-e9a87a377cd5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Request method failure captured: Jun 27 21:20:35.050337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d HTTP/1.1 Jun 27 21:20:35.050337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:20:35.050337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:20:35.050337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:20:35.050337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:20:35.050337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:20:35.050337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:20:35.050337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:20:35.050337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:20:35.050337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh4MtCUDYlYQAgDha4AvmudCjuvwvHIGW1y1KgJ39KrW_dqcQEVlDzD-XMR-AlLP_0KAJKcuGUS2Ns8xi3pVbviq_M178w8YodWUnffgx7-aVG6aPoo5C66rO-fFAe_0HQHN6yZX1qOaX4CMMRqy5foO5lwLx89IL8-rGKilhGX1QM8 Jun 27 21:20:35.050337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:20:35.050337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:20:35.050337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:20:35.050337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:20:35.050337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:20:35.050337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:20:35.050337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: a2a3853bab51428eb89ff228e5f29ef4 Jun 27 21:20:35.050337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2086275792 Jun 27 21:20:35.050337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:20:35.050337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:20:35.052220 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a2a3853bab51428eb89ff228e5f29ef4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a2a3853bab51428eb89ff228e5f29ef4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a2a3853bab51428eb89ff228e5f29ef4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a2a3853bab51428eb89ff228e5f29ef4"}]}] Jun 27 21:20:35.052220 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2086275792 Jun 27 21:20:35.052220 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: a2a3853bab51428eb89ff228e5f29ef4 Jun 27 21:20:35.052220 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2086275792 Jun 27 21:20:35.052220 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-ServerRescueNegativeTestJSON-2086275792-project Jun 27 21:20:35.052220 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:20:35.052220 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:20:35.052220 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: a0408ee5961249d1bd296a6ef1a030a9 Jun 27 21:20:35.052220 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2086275792-project Jun 27 21:20:35.052220 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:20:35.052220 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance 3a1409c2-ecfa-4ed4-b547-aa5667367e5d could not be found. Jun 27 21:20:35.052220 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '3a1409c2-ecfa-4ed4-b547-aa5667367e5d'} Jun 27 21:20:35.053127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:20:35.053127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:35.053127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:20:35.053127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:20:35.053127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:20:35.053127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:20:35.053127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:20:35.053127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:20:35.053127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:20:35.053127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:20:35.053127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a1409c2-ecfa-4ed4-b547-aa5667367e5d could not be found. Jun 27 21:20:35.053127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:20:35.053127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:20:35.053127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:20:35.053127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:35.053127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:20:35.053127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:20:35.053127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:20:35.053127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:20:35.053127 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:20:35.054637 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:20:35.054637 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:20:35.054637 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:20:35.054637 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:20:35.054637 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:20:35.054637 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:20:35.054637 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:20:35.054637 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a1409c2-ecfa-4ed4-b547-aa5667367e5d could not be found. Jun 27 21:20:35.054637 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:20:35.054637 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:20:35.054637 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:20:35.054637 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:35.054637 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:20:35.054637 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:20:35.054637 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:20:35.054637 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:20:35.054637 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a1409c2-ecfa-4ed4-b547-aa5667367e5d could not be found. Jun 27 21:20:35.054637 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:20:35.055892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4d4c4589-ecba-4300-9763-e9a87a377cd5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Returning 404 to user: Instance 3a1409c2-ecfa-4ed4-b547-aa5667367e5d could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:20:35.055892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4d4c4589-ecba-4300-9763-e9a87a377cd5 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d" status: 404 len: 111 microversion: 2.1 time: 0.046013 Jun 27 21:20:35.055892 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 286/594] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:35 2022] GET /compute/v2.1/servers/3a1409c2-ecfa-4ed4-b547-aa5667367e5d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 21:20:35.061279 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-79f8d680-3ccb-424e-8d14-c861ea1d1862 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '.version_select at 0x7f835433b160>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:35.089325 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-79f8d680-3ccb-424e-8d14-c861ea1d1862 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013538233" status: 202 len: 0 microversion: 2.1 time: 0.031622 Jun 27 21:20:35.093078 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 287/595] 10.222.0.13 () {58 vars in 1220 bytes} [Mon Jun 27 21:20:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013538233 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:20:35.130651 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-385f5378-578a-43e0-b0be-594a27b37a99 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:35.139428 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-385f5378-578a-43e0-b0be-594a27b37a99 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5" status: 200 len: 1362 microversion: 2.1 time: 0.203367 Jun 27 21:20:35.140112 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 309/596] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:34 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:36.158393 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-603bc31e-35e2-4f2f-b9ac-cc63614c17f7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:36.159006 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-603bc31e-35e2-4f2f-b9ac-cc63614c17f7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:36.166946 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-603bc31e-35e2-4f2f-b9ac-cc63614c17f7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:36.167381 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-603bc31e-35e2-4f2f-b9ac-cc63614c17f7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:36.168400 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-603bc31e-35e2-4f2f-b9ac-cc63614c17f7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:36.168845 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-603bc31e-35e2-4f2f-b9ac-cc63614c17f7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:36.327826 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-603bc31e-35e2-4f2f-b9ac-cc63614c17f7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:36.336435 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-603bc31e-35e2-4f2f-b9ac-cc63614c17f7 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5" status: 200 len: 1362 microversion: 2.1 time: 0.182896 Jun 27 21:20:36.337031 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 288/597] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:36 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:36.762755 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-35aa3bd2-bc5a-428b-8c88-d5cc630d377f req-b4155f86-a444-4638-845c-f54ace64b14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "624274f6-859f-4e03-9c00-90574d06b2c5", "name": "network-vif-plugged", "status": "completed", "tag": "67ccd3c5-1cc9-425f-a7e3-26606e621d54"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:36.772060 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-35aa3bd2-bc5a-428b-8c88-d5cc630d377f req-b4155f86-a444-4638-845c-f54ace64b14e service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:36.772496 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-35aa3bd2-bc5a-428b-8c88-d5cc630d377f req-b4155f86-a444-4638-845c-f54ace64b14e service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:36.786992 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-35aa3bd2-bc5a-428b-8c88-d5cc630d377f req-b4155f86-a444-4638-845c-f54ace64b14e service nova] Creating event network-vif-plugged:67ccd3c5-1cc9-425f-a7e3-26606e621d54 for instance 624274f6-859f-4e03-9c00-90574d06b2c5 on hv-cinder-84773 Jun 27 21:20:36.792841 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-35aa3bd2-bc5a-428b-8c88-d5cc630d377f req-b4155f86-a444-4638-845c-f54ace64b14e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034099 Jun 27 21:20:36.793641 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 310/598] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:37.354950 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9ccd6fab-2272-4dc1-aec3-a18ddd0faa37 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:37.355486 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9ccd6fab-2272-4dc1-aec3-a18ddd0faa37 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:37.362286 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ccd6fab-2272-4dc1-aec3-a18ddd0faa37 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:37.362728 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ccd6fab-2272-4dc1-aec3-a18ddd0faa37 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:37.363482 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ccd6fab-2272-4dc1-aec3-a18ddd0faa37 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:37.363937 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ccd6fab-2272-4dc1-aec3-a18ddd0faa37 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:37.510720 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9ccd6fab-2272-4dc1-aec3-a18ddd0faa37 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:37.519155 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9ccd6fab-2272-4dc1-aec3-a18ddd0faa37 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5" status: 200 len: 1362 microversion: 2.1 time: 0.168786 Jun 27 21:20:37.519764 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 289/599] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:37 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:38.039112 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-cf77bf2a-4184-40f4-aa67-1fcf3b288cde tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:38.039699 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-cf77bf2a-4184-40f4-aa67-1fcf3b288cde tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:38.047129 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cf77bf2a-4184-40f4-aa67-1fcf3b288cde tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:38.047548 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cf77bf2a-4184-40f4-aa67-1fcf3b288cde tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:38.048299 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cf77bf2a-4184-40f4-aa67-1fcf3b288cde tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:38.048720 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cf77bf2a-4184-40f4-aa67-1fcf3b288cde tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:38.077271 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-cf77bf2a-4184-40f4-aa67-1fcf3b288cde tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Going to try to terminate instance {{(pid=117891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:20:38.158139 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-cf77bf2a-4184-40f4-aa67-1fcf3b288cde tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 204 len: 0 microversion: 2.1 time: 0.123653 Jun 27 21:20:38.158740 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 311/600] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:20:38 2022] DELETE /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:20:38.168198 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-87357a3e-eb5f-4916-9b79-fa575d3610df tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:38.168803 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-87357a3e-eb5f-4916-9b79-fa575d3610df tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:38.175439 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-87357a3e-eb5f-4916-9b79-fa575d3610df tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:38.175878 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-87357a3e-eb5f-4916-9b79-fa575d3610df tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:38.176659 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-87357a3e-eb5f-4916-9b79-fa575d3610df tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:38.177126 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-87357a3e-eb5f-4916-9b79-fa575d3610df tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:38.347943 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-87357a3e-eb5f-4916-9b79-fa575d3610df tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:38.356534 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-87357a3e-eb5f-4916-9b79-fa575d3610df tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1507 microversion: 2.1 time: 0.192998 Jun 27 21:20:38.357285 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 290/601] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:38 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1507 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:20:38.538135 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4f000013-848c-4b04-9044-34dab4fe8f2a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:38.538722 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4f000013-848c-4b04-9044-34dab4fe8f2a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:38.545394 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f000013-848c-4b04-9044-34dab4fe8f2a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:38.545841 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f000013-848c-4b04-9044-34dab4fe8f2a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:38.546611 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f000013-848c-4b04-9044-34dab4fe8f2a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:38.547038 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f000013-848c-4b04-9044-34dab4fe8f2a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:38.689503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4f000013-848c-4b04-9044-34dab4fe8f2a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:38.699750 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4f000013-848c-4b04-9044-34dab4fe8f2a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5" status: 200 len: 1548 microversion: 2.1 time: 0.166046 Jun 27 21:20:38.700339 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 312/602] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:38 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:38.717466 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2556ed43-384f-41bf-9ba2-4df8fd0bc882 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:38.717985 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2556ed43-384f-41bf-9ba2-4df8fd0bc882 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:38.724626 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2556ed43-384f-41bf-9ba2-4df8fd0bc882 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:38.725111 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2556ed43-384f-41bf-9ba2-4df8fd0bc882 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:38.725868 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2556ed43-384f-41bf-9ba2-4df8fd0bc882 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:38.726298 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2556ed43-384f-41bf-9ba2-4df8fd0bc882 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:38.812235 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2556ed43-384f-41bf-9ba2-4df8fd0bc882 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099024 Jun 27 21:20:38.812849 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 291/603] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 27 21:20:38 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:39.378633 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-66515484-3563-4eed-b343-cc49425af04f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:39.379703 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-66515484-3563-4eed-b343-cc49425af04f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:39.391032 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-66515484-3563-4eed-b343-cc49425af04f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:39.391803 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-66515484-3563-4eed-b343-cc49425af04f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:39.393251 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-66515484-3563-4eed-b343-cc49425af04f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:39.394017 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-66515484-3563-4eed-b343-cc49425af04f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:39.568316 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-66515484-3563-4eed-b343-cc49425af04f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:39.581782 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-66515484-3563-4eed-b343-cc49425af04f tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1507 microversion: 2.1 time: 0.210328 Jun 27 21:20:39.582770 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 313/604] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:39 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1507 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:40.147756 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-a9796b9c-82d9-40c1-adcc-e75f6ed0725d req-60547055-225e-492d-9d52-5ff114e853cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "624274f6-859f-4e03-9c00-90574d06b2c5", "tag": "67ccd3c5-1cc9-425f-a7e3-26606e621d54"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:40.157996 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a9796b9c-82d9-40c1-adcc-e75f6ed0725d req-60547055-225e-492d-9d52-5ff114e853cc service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:40.158815 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a9796b9c-82d9-40c1-adcc-e75f6ed0725d req-60547055-225e-492d-9d52-5ff114e853cc service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:40.173389 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-a9796b9c-82d9-40c1-adcc-e75f6ed0725d req-60547055-225e-492d-9d52-5ff114e853cc service nova] Creating event network-changed:67ccd3c5-1cc9-425f-a7e3-26606e621d54 for instance 624274f6-859f-4e03-9c00-90574d06b2c5 on hv-cinder-84773 Jun 27 21:20:40.180983 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-a9796b9c-82d9-40c1-adcc-e75f6ed0725d req-60547055-225e-492d-9d52-5ff114e853cc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037773 Jun 27 21:20:40.182359 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 292/605] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:20:40.601025 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b0fc5045-472d-497e-aaf5-02719e0259b9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:40.601727 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b0fc5045-472d-497e-aaf5-02719e0259b9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:40.609229 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b0fc5045-472d-497e-aaf5-02719e0259b9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:40.609666 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b0fc5045-472d-497e-aaf5-02719e0259b9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:40.610446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b0fc5045-472d-497e-aaf5-02719e0259b9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:40.610883 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b0fc5045-472d-497e-aaf5-02719e0259b9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:40.800429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b0fc5045-472d-497e-aaf5-02719e0259b9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:40.809582 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b0fc5045-472d-497e-aaf5-02719e0259b9 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1507 microversion: 2.1 time: 0.212526 Jun 27 21:20:40.810186 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 314/606] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:40 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:41.830254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-94ea2697-1ee6-41de-906b-225adb15727a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:41.831336 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-94ea2697-1ee6-41de-906b-225adb15727a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:41.839212 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-94ea2697-1ee6-41de-906b-225adb15727a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:41.839709 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-94ea2697-1ee6-41de-906b-225adb15727a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:41.840590 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-94ea2697-1ee6-41de-906b-225adb15727a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:41.841101 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-94ea2697-1ee6-41de-906b-225adb15727a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:42.148717 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-94ea2697-1ee6-41de-906b-225adb15727a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:42.163463 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-94ea2697-1ee6-41de-906b-225adb15727a tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1507 microversion: 2.1 time: 0.337561 Jun 27 21:20:42.164903 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 293/607] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:41 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1507 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:42.484064 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ea2679ad-9af6-4c99-891f-1b5af795194a tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d062021-72d2-4884-98c7-3d46bdb1128d"}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:42.485439 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ea2679ad-9af6-4c99-891f-1b5af795194a tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:42.493250 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ea2679ad-9af6-4c99-891f-1b5af795194a tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:42.494659 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ea2679ad-9af6-4c99-891f-1b5af795194a tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:42.494864 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ea2679ad-9af6-4c99-891f-1b5af795194a tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:42.495352 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ea2679ad-9af6-4c99-891f-1b5af795194a tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:42.609407 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-ea2679ad-9af6-4c99-891f-1b5af795194a tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] HTTP exception thrown: Invalid volume: volume 5d062021-72d2-4884-98c7-3d46bdb1128d is already attached to instances: 397198b2-1a3a-4947-8184-2f3c7a817da9 Jun 27 21:20:42.611896 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ea2679ad-9af6-4c99-891f-1b5af795194a tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Request method failure captured: Jun 27 21:20:42.611896 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: POST /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9/os-volume_attachments HTTP/1.1 Jun 27 21:20:42.611896 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:20:42.611896 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:20:42.611896 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:20:42.611896 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 74 Jun 27 21:20:42.611896 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:20:42.611896 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:20:42.611896 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:20:42.611896 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:20:42.611896 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh4YqTj0KDKiAA8-Ybj3-gdHviC0IY0gRPX_-zc843y94FxFezSOatXJ1qtJsvtWNZXTTXRx1zonPA_7MuDBpdKOf2Im45jkxvzu24Ha4gAYEuaWcvZ6e6-OgMyPsQ6l_aEAmdX7x7dpM8AjaVFtaQBsb85u09RPN7A4hzw049NiIF4 Jun 27 21:20:42.611896 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:20:42.611896 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:20:42.611896 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:20:42.611896 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:20:42.611896 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:20:42.611896 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:20:42.611896 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:20:42.611896 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:20:42.611896 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:20:42.611896 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:20:42.614498 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a74724882c84e8f893f5be0f59a9581", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}] Jun 27 21:20:42.614498 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:20:42.614498 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:20:42.614498 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:20:42.614498 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:20:42.614498 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:20:42.614498 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:20:42.614498 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: fff9f1fc84a54b83a7a384965f40c9d9 Jun 27 21:20:42.614498 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:20:42.614498 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Jun 27 21:20:42.614498 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {"volumeAttachment": {"volumeId": "5d062021-72d2-4884-98c7-3d46bdb1128d"}} Jun 27 21:20:42.614498 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: > Jun 27 21:20:42.615975 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Invalid volume: volume 5d062021-72d2-4884-98c7-3d46bdb1128d is already attached to instances: 397198b2-1a3a-4947-8184-2f3c7a817da9 Jun 27 21:20:42.615975 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'server_id': '397198b2-1a3a-4947-8184-2f3c7a817da9', 'body': {'volumeAttachment': {'volumeId': '5d062021-72d2-4884-98c7-3d46bdb1128d'}}} Jun 27 21:20:42.615975 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:20:42.615975 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:42.615975 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 27 21:20:42.615975 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 27 21:20:42.615975 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 21:20:42.615975 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 21:20:42.615975 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 27 21:20:42.615975 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 27 21:20:42.615975 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 27 21:20:42.615975 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 27 21:20:42.615975 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 27 21:20:42.615975 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 27 21:20:42.615975 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5d062021-72d2-4884-98c7-3d46bdb1128d is already attached to instances: 397198b2-1a3a-4947-8184-2f3c7a817da9 Jun 27 21:20:42.615975 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:20:42.615975 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:20:42.615975 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:20:42.615975 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:42.620907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:20:42.620907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:20:42.620907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:20:42.620907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:20:42.620907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:20:42.620907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:20:42.620907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 21:20:42.620907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 21:20:42.620907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 21:20:42.620907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 21:20:42.620907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 21:20:42.620907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 21:20:42.620907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 27 21:20:42.620907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 27 21:20:42.620907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5d062021-72d2-4884-98c7-3d46bdb1128d is already attached to instances: 397198b2-1a3a-4947-8184-2f3c7a817da9 Jun 27 21:20:42.620907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:20:42.620907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:20:42.620907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:20:42.620907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:42.620907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:20:42.625158 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:20:42.625158 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:20:42.625158 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:20:42.625158 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5d062021-72d2-4884-98c7-3d46bdb1128d is already attached to instances: 397198b2-1a3a-4947-8184-2f3c7a817da9 Jun 27 21:20:42.625158 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:20:42.625158 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ea2679ad-9af6-4c99-891f-1b5af795194a tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Returning 400 to user: Invalid volume: volume 5d062021-72d2-4884-98c7-3d46bdb1128d is already attached to instances: 397198b2-1a3a-4947-8184-2f3c7a817da9 {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:20:42.625158 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ea2679ad-9af6-4c99-891f-1b5af795194a tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "POST /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.134990 Jun 27 21:20:42.625158 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 315/608] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 27 21:20:42 2022] POST /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9/os-volume_attachments => generated 174 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 27 21:20:42.726701 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fd5d0690-17b6-48ab-b23e-b6b7db5dbd5a tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:42.727578 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fd5d0690-17b6-48ab-b23e-b6b7db5dbd5a tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:42.738077 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd5d0690-17b6-48ab-b23e-b6b7db5dbd5a tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:42.738969 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd5d0690-17b6-48ab-b23e-b6b7db5dbd5a tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:42.740151 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd5d0690-17b6-48ab-b23e-b6b7db5dbd5a tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:42.740902 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd5d0690-17b6-48ab-b23e-b6b7db5dbd5a tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:42.880195 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-5009a6a2-79f8-4688-b8db-09a047307e39 req-4ab9c014-e878-477b-a075-c446ca132cfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d240a8f-534e-471d-817b-3d79b449bfeb", "name": "network-vif-deleted", "tag": "a6130374-d711-4d19-a701-67a2bc874882"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:42.896976 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-5009a6a2-79f8-4688-b8db-09a047307e39 req-4ab9c014-e878-477b-a075-c446ca132cfc service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:42.897745 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-5009a6a2-79f8-4688-b8db-09a047307e39 req-4ab9c014-e878-477b-a075-c446ca132cfc service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:42.917528 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-5009a6a2-79f8-4688-b8db-09a047307e39 req-4ab9c014-e878-477b-a075-c446ca132cfc service nova] Creating event network-vif-deleted:a6130374-d711-4d19-a701-67a2bc874882 for instance 4d240a8f-534e-471d-817b-3d79b449bfeb on hv-cinder-84773 Jun 27 21:20:42.922546 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-fd5d0690-17b6-48ab-b23e-b6b7db5dbd5a tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lazy-loading 'services' on Instance uuid 397198b2-1a3a-4947-8184-2f3c7a817da9 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:20:42.927936 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-5009a6a2-79f8-4688-b8db-09a047307e39 req-4ab9c014-e878-477b-a075-c446ca132cfc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054336 Jun 27 21:20:42.930087 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 316/609] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:43.070549 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fd5d0690-17b6-48ab-b23e-b6b7db5dbd5a tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "DELETE /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9/os-volume_attachments/5d062021-72d2-4884-98c7-3d46bdb1128d" status: 202 len: 0 microversion: 2.1 time: 0.350224 Jun 27 21:20:43.072098 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 294/610] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 27 21:20:42 2022] DELETE /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9/os-volume_attachments/5d062021-72d2-4884-98c7-3d46bdb1128d => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:20:43.082559 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4de2d1df-efce-46ea-86e7-4978095b4cbe tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:43.083610 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4de2d1df-efce-46ea-86e7-4978095b4cbe tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:43.092577 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4de2d1df-efce-46ea-86e7-4978095b4cbe tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:43.093433 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4de2d1df-efce-46ea-86e7-4978095b4cbe tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:43.094470 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4de2d1df-efce-46ea-86e7-4978095b4cbe tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:43.095135 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4de2d1df-efce-46ea-86e7-4978095b4cbe tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:43.137707 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4de2d1df-efce-46ea-86e7-4978095b4cbe tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059470 Jun 27 21:20:43.138827 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 317/611] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 27 21:20:43 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:20:43.189440 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fc3929af-5c0c-43c2-b8e9-4a4e56722685 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:43.190255 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fc3929af-5c0c-43c2-b8e9-4a4e56722685 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:43.197938 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc3929af-5c0c-43c2-b8e9-4a4e56722685 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:43.198448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc3929af-5c0c-43c2-b8e9-4a4e56722685 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:43.199802 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc3929af-5c0c-43c2-b8e9-4a4e56722685 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:43.200490 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc3929af-5c0c-43c2-b8e9-4a4e56722685 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:43.237778 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc3929af-5c0c-43c2-b8e9-4a4e56722685 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:43.238320 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc3929af-5c0c-43c2-b8e9-4a4e56722685 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:43.238836 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-fc3929af-5c0c-43c2-b8e9-4a4e56722685 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lazy-loading 'fault' on Instance uuid 4d240a8f-534e-471d-817b-3d79b449bfeb {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:20:43.298412 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fc3929af-5c0c-43c2-b8e9-4a4e56722685 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:43.310375 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fc3929af-5c0c-43c2-b8e9-4a4e56722685 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 200 len: 1311 microversion: 2.1 time: 0.125210 Jun 27 21:20:43.311393 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 295/612] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:43 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 1311 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:44.153347 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-88d05367-1e42-474a-bc60-a8044b45b435 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:44.154291 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-88d05367-1e42-474a-bc60-a8044b45b435 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:44.165259 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-88d05367-1e42-474a-bc60-a8044b45b435 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:44.165940 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-88d05367-1e42-474a-bc60-a8044b45b435 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:44.166876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-88d05367-1e42-474a-bc60-a8044b45b435 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:44.167311 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-88d05367-1e42-474a-bc60-a8044b45b435 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:44.202281 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-88d05367-1e42-474a-bc60-a8044b45b435 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053931 Jun 27 21:20:44.202899 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 318/613] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 27 21:20:44 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:44.336358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-025d2a8d-1371-4755-a1b1-d7056958e57d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:44.337999 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-025d2a8d-1371-4755-a1b1-d7056958e57d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 4d240a8f-534e-471d-817b-3d79b449bfeb] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:44.345883 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-025d2a8d-1371-4755-a1b1-d7056958e57d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:44.346346 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-025d2a8d-1371-4755-a1b1-d7056958e57d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:44.347157 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-025d2a8d-1371-4755-a1b1-d7056958e57d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:44.347790 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-025d2a8d-1371-4755-a1b1-d7056958e57d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:44.366377 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-025d2a8d-1371-4755-a1b1-d7056958e57d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] HTTP exception thrown: Instance 4d240a8f-534e-471d-817b-3d79b449bfeb could not be found. Jun 27 21:20:44.370380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-025d2a8d-1371-4755-a1b1-d7056958e57d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Request method failure captured: Jun 27 21:20:44.370380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb HTTP/1.1 Jun 27 21:20:44.370380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:20:44.370380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:20:44.370380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:20:44.370380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:20:44.370380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:20:44.370380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:20:44.370380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:20:44.370380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:20:44.370380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh4MtCUDYlYQAgDha4AvmudCjuvwvHIGW1y1KgJ39KrW_dqcQEVlDzD-XMR-AlLP_0KAJKcuGUS2Ns8xi3pVbviq_M178w8YodWUnffgx7-aVG6aPoo5C66rO-fFAe_0HQHN6yZX1qOaX4CMMRqy5foO5lwLx89IL8-rGKilhGX1QM8 Jun 27 21:20:44.370380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:20:44.370380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:20:44.370380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:20:44.370380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:20:44.370380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:20:44.370380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:20:44.370380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: a2a3853bab51428eb89ff228e5f29ef4 Jun 27 21:20:44.370380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2086275792 Jun 27 21:20:44.370380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:20:44.370380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:20:44.372591 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a2a3853bab51428eb89ff228e5f29ef4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a2a3853bab51428eb89ff228e5f29ef4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a2a3853bab51428eb89ff228e5f29ef4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a2a3853bab51428eb89ff228e5f29ef4"}]}] Jun 27 21:20:44.372591 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2086275792 Jun 27 21:20:44.372591 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: a2a3853bab51428eb89ff228e5f29ef4 Jun 27 21:20:44.372591 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2086275792 Jun 27 21:20:44.372591 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-ServerRescueNegativeTestJSON-2086275792-project Jun 27 21:20:44.372591 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:20:44.372591 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:20:44.372591 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: a0408ee5961249d1bd296a6ef1a030a9 Jun 27 21:20:44.372591 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2086275792-project Jun 27 21:20:44.372591 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:20:44.372591 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance 4d240a8f-534e-471d-817b-3d79b449bfeb could not be found. Jun 27 21:20:44.372591 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '4d240a8f-534e-471d-817b-3d79b449bfeb'} Jun 27 21:20:44.374012 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:20:44.374012 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:44.374012 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:20:44.374012 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:20:44.374012 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:20:44.374012 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:20:44.374012 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:20:44.374012 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:20:44.374012 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:20:44.374012 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:20:44.374012 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d240a8f-534e-471d-817b-3d79b449bfeb could not be found. Jun 27 21:20:44.374012 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:20:44.374012 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:20:44.374012 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:20:44.374012 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:44.374012 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:20:44.374012 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:20:44.374012 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:20:44.374012 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:20:44.374012 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:20:44.379269 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:20:44.379269 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:20:44.379269 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:20:44.379269 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:20:44.379269 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:20:44.379269 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:20:44.379269 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:20:44.379269 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d240a8f-534e-471d-817b-3d79b449bfeb could not be found. Jun 27 21:20:44.379269 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:20:44.379269 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:20:44.379269 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:20:44.379269 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:44.379269 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:20:44.379269 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:20:44.379269 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:20:44.379269 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:20:44.379269 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d240a8f-534e-471d-817b-3d79b449bfeb could not be found. Jun 27 21:20:44.379269 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:20:44.382901 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-025d2a8d-1371-4755-a1b1-d7056958e57d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Returning 404 to user: Instance 4d240a8f-534e-471d-817b-3d79b449bfeb could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:20:44.382901 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-025d2a8d-1371-4755-a1b1-d7056958e57d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb" status: 404 len: 111 microversion: 2.1 time: 0.043924 Jun 27 21:20:44.382901 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 296/614] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:44 2022] GET /compute/v2.1/servers/4d240a8f-534e-471d-817b-3d79b449bfeb => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:20:44.388194 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c2f84349-81ae-48d5-89ff-6db707dc9285 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:44.389059 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c2f84349-81ae-48d5-89ff-6db707dc9285 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:44.400047 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c2f84349-81ae-48d5-89ff-6db707dc9285 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:44.401125 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c2f84349-81ae-48d5-89ff-6db707dc9285 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:44.402601 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c2f84349-81ae-48d5-89ff-6db707dc9285 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:44.403498 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c2f84349-81ae-48d5-89ff-6db707dc9285 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:44.434265 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c2f84349-81ae-48d5-89ff-6db707dc9285 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Going to try to terminate instance {{(pid=117891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:20:44.531779 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c2f84349-81ae-48d5-89ff-6db707dc9285 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "DELETE /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 204 len: 0 microversion: 2.1 time: 0.150673 Jun 27 21:20:44.533068 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 319/615] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:20:44 2022] DELETE /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:20:44.542283 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-14d4490b-9b8a-4949-8181-27830d2f7b77 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:44.542902 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-14d4490b-9b8a-4949-8181-27830d2f7b77 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:44.549512 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-14d4490b-9b8a-4949-8181-27830d2f7b77 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:44.549958 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-14d4490b-9b8a-4949-8181-27830d2f7b77 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:44.550748 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-14d4490b-9b8a-4949-8181-27830d2f7b77 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:44.551176 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-14d4490b-9b8a-4949-8181-27830d2f7b77 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:44.711509 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-14d4490b-9b8a-4949-8181-27830d2f7b77 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:44.720005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-14d4490b-9b8a-4949-8181-27830d2f7b77 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1521 microversion: 2.1 time: 0.181740 Jun 27 21:20:44.720596 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 297/616] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:44 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:45.214943 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-96bbdd37-3462-43af-a9f0-96fb3a05ef91 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:45.215954 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-96bbdd37-3462-43af-a9f0-96fb3a05ef91 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:45.223179 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-96bbdd37-3462-43af-a9f0-96fb3a05ef91 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:45.223602 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-96bbdd37-3462-43af-a9f0-96fb3a05ef91 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:45.224373 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-96bbdd37-3462-43af-a9f0-96fb3a05ef91 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:45.224787 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-96bbdd37-3462-43af-a9f0-96fb3a05ef91 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:45.256781 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-96bbdd37-3462-43af-a9f0-96fb3a05ef91 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046369 Jun 27 21:20:45.257718 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 320/617] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 27 21:20:45 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 27 21:20:45.315072 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6c7991b7-a968-4ca9-b880-9f767016b2b6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:45.315566 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6c7991b7-a968-4ca9-b880-9f767016b2b6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:45.322019 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c7991b7-a968-4ca9-b880-9f767016b2b6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:45.322520 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c7991b7-a968-4ca9-b880-9f767016b2b6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:45.323296 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c7991b7-a968-4ca9-b880-9f767016b2b6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:45.323735 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c7991b7-a968-4ca9-b880-9f767016b2b6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:45.352754 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6c7991b7-a968-4ca9-b880-9f767016b2b6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:20:45.445124 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6c7991b7-a968-4ca9-b880-9f767016b2b6 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "DELETE /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9" status: 204 len: 0 microversion: 2.1 time: 0.133621 Jun 27 21:20:45.445831 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 298/618] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:20:45 2022] DELETE /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:20:45.454871 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4aaba681-dfa4-4c07-b51c-c9d64bcdc8ff tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:45.455522 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4aaba681-dfa4-4c07-b51c-c9d64bcdc8ff tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:45.462557 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4aaba681-dfa4-4c07-b51c-c9d64bcdc8ff tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:45.463048 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4aaba681-dfa4-4c07-b51c-c9d64bcdc8ff tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:45.463805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4aaba681-dfa4-4c07-b51c-c9d64bcdc8ff tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:45.464239 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4aaba681-dfa4-4c07-b51c-c9d64bcdc8ff tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:45.617984 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4aaba681-dfa4-4c07-b51c-c9d64bcdc8ff tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:45.628092 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4aaba681-dfa4-4c07-b51c-c9d64bcdc8ff tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9" status: 200 len: 1679 microversion: 2.1 time: 0.177074 Jun 27 21:20:45.628685 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 321/619] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:45 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:45.741890 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b9ee179a-af2d-4c8a-bf04-de542fcedb93 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:45.742627 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b9ee179a-af2d-4c8a-bf04-de542fcedb93 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:45.749623 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b9ee179a-af2d-4c8a-bf04-de542fcedb93 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:45.750070 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b9ee179a-af2d-4c8a-bf04-de542fcedb93 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:45.750867 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b9ee179a-af2d-4c8a-bf04-de542fcedb93 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:45.751303 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b9ee179a-af2d-4c8a-bf04-de542fcedb93 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:45.772277 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:45.899336 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b9ee179a-af2d-4c8a-bf04-de542fcedb93 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:45.908163 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b9ee179a-af2d-4c8a-bf04-de542fcedb93 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1521 microversion: 2.1 time: 0.170564 Jun 27 21:20:45.908751 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 299/620] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:45 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:46.645955 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7b2767a6-a437-4929-966e-0bbf701539f7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:46.646650 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7b2767a6-a437-4929-966e-0bbf701539f7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:46.654348 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7b2767a6-a437-4929-966e-0bbf701539f7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:46.654794 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7b2767a6-a437-4929-966e-0bbf701539f7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:46.655591 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7b2767a6-a437-4929-966e-0bbf701539f7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:46.656028 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7b2767a6-a437-4929-966e-0bbf701539f7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:46.673478 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:46.797402 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7b2767a6-a437-4929-966e-0bbf701539f7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:46.805301 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7b2767a6-a437-4929-966e-0bbf701539f7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9" status: 200 len: 1679 microversion: 2.1 time: 0.163337 Jun 27 21:20:46.805964 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 322/621] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:46 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:46.925985 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c2ceffc0-eab4-462f-a80e-a5be04ecb47d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:46.926623 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c2ceffc0-eab4-462f-a80e-a5be04ecb47d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:46.929030 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:46.935403 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c2ceffc0-eab4-462f-a80e-a5be04ecb47d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:46.935844 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c2ceffc0-eab4-462f-a80e-a5be04ecb47d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:46.936623 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c2ceffc0-eab4-462f-a80e-a5be04ecb47d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:46.937105 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c2ceffc0-eab4-462f-a80e-a5be04ecb47d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:47.078435 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c2ceffc0-eab4-462f-a80e-a5be04ecb47d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:47.086782 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c2ceffc0-eab4-462f-a80e-a5be04ecb47d tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1521 microversion: 2.1 time: 0.164723 Jun 27 21:20:47.087351 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 300/622] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:46 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:47.824249 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-eed3b50d-8d9c-4bc8-a532-de76aa877e36 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:47.824877 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-eed3b50d-8d9c-4bc8-a532-de76aa877e36 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:47.831659 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-eed3b50d-8d9c-4bc8-a532-de76aa877e36 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:47.832097 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-eed3b50d-8d9c-4bc8-a532-de76aa877e36 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:47.832850 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-eed3b50d-8d9c-4bc8-a532-de76aa877e36 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:47.833300 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-eed3b50d-8d9c-4bc8-a532-de76aa877e36 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:47.969361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-eed3b50d-8d9c-4bc8-a532-de76aa877e36 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:47.977163 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-eed3b50d-8d9c-4bc8-a532-de76aa877e36 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9" status: 200 len: 1679 microversion: 2.1 time: 0.157748 Jun 27 21:20:47.977739 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 323/623] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:47 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:48.104540 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c56a0f35-51e8-4121-b64d-9f3fa4188129 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:48.105311 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c56a0f35-51e8-4121-b64d-9f3fa4188129 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:48.112251 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c56a0f35-51e8-4121-b64d-9f3fa4188129 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:48.112700 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c56a0f35-51e8-4121-b64d-9f3fa4188129 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:48.113522 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c56a0f35-51e8-4121-b64d-9f3fa4188129 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:48.114079 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c56a0f35-51e8-4121-b64d-9f3fa4188129 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:48.250672 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c56a0f35-51e8-4121-b64d-9f3fa4188129 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:48.258678 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c56a0f35-51e8-4121-b64d-9f3fa4188129 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1521 microversion: 2.1 time: 0.158523 Jun 27 21:20:48.259227 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 301/624] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:48 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:48.995106 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f44ae24a-4d6a-4c47-9f75-92048a8d72f4 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:48.995727 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f44ae24a-4d6a-4c47-9f75-92048a8d72f4 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:49.002772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f44ae24a-4d6a-4c47-9f75-92048a8d72f4 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:49.003241 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f44ae24a-4d6a-4c47-9f75-92048a8d72f4 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:49.004011 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f44ae24a-4d6a-4c47-9f75-92048a8d72f4 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:49.004441 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f44ae24a-4d6a-4c47-9f75-92048a8d72f4 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:49.144873 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f44ae24a-4d6a-4c47-9f75-92048a8d72f4 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:49.154166 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f44ae24a-4d6a-4c47-9f75-92048a8d72f4 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9" status: 200 len: 1679 microversion: 2.1 time: 0.163156 Jun 27 21:20:49.154973 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 324/625] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:48 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:49.275812 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-11154252-0069-43e8-84f3-788763feedd0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:49.276623 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-11154252-0069-43e8-84f3-788763feedd0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:49.283364 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-11154252-0069-43e8-84f3-788763feedd0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:49.283815 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-11154252-0069-43e8-84f3-788763feedd0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:49.284602 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-11154252-0069-43e8-84f3-788763feedd0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:49.285068 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-11154252-0069-43e8-84f3-788763feedd0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:49.438227 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-11154252-0069-43e8-84f3-788763feedd0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:49.446245 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-11154252-0069-43e8-84f3-788763feedd0 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1521 microversion: 2.1 time: 0.174836 Jun 27 21:20:49.447037 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 302/626] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:49 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:50.172772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-89ed0c9f-78fd-4c84-ae72-e7d3705fa94e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:50.173418 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-89ed0c9f-78fd-4c84-ae72-e7d3705fa94e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:50.180225 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-89ed0c9f-78fd-4c84-ae72-e7d3705fa94e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:50.180693 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-89ed0c9f-78fd-4c84-ae72-e7d3705fa94e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:50.181708 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-89ed0c9f-78fd-4c84-ae72-e7d3705fa94e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:50.182141 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-89ed0c9f-78fd-4c84-ae72-e7d3705fa94e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:50.401879 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-89ed0c9f-78fd-4c84-ae72-e7d3705fa94e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:50.410012 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-89ed0c9f-78fd-4c84-ae72-e7d3705fa94e tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9" status: 200 len: 1679 microversion: 2.1 time: 0.241438 Jun 27 21:20:50.410725 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 325/627] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:50 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 => generated 1679 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:50.467176 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d154e3b1-ddef-434e-974b-7c361bdc9a51 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:50.468268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d154e3b1-ddef-434e-974b-7c361bdc9a51 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:50.475328 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d154e3b1-ddef-434e-974b-7c361bdc9a51 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:50.476274 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d154e3b1-ddef-434e-974b-7c361bdc9a51 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:50.477086 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d154e3b1-ddef-434e-974b-7c361bdc9a51 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:50.477489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d154e3b1-ddef-434e-974b-7c361bdc9a51 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:50.797324 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-74f82050-b7b4-4ef9-8eec-a13e5f854b56 req-c4d118c3-ce53-4153-959d-25ff032911d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53419a08-6ab0-4f25-82f9-81496ca7440e", "name": "network-vif-deleted", "tag": "e0071d9d-e534-4717-a5e1-b60e19b215c7"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:50.798610 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d154e3b1-ddef-434e-974b-7c361bdc9a51 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0408ee5961249d1bd296a6ef1a030a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3853bab51428eb89ff228e5f29ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:50.809064 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-74f82050-b7b4-4ef9-8eec-a13e5f854b56 req-c4d118c3-ce53-4153-959d-25ff032911d3 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:50.809655 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-74f82050-b7b4-4ef9-8eec-a13e5f854b56 req-c4d118c3-ce53-4153-959d-25ff032911d3 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:50.814909 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d154e3b1-ddef-434e-974b-7c361bdc9a51 tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 200 len: 1521 microversion: 2.1 time: 0.353136 Jun 27 21:20:50.815918 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 303/628] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:50 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:20:50.835907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-74f82050-b7b4-4ef9-8eec-a13e5f854b56 req-c4d118c3-ce53-4153-959d-25ff032911d3 service nova] Creating event network-vif-deleted:e0071d9d-e534-4717-a5e1-b60e19b215c7 for instance 53419a08-6ab0-4f25-82f9-81496ca7440e on hv-cinder-84773 Jun 27 21:20:50.842322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-74f82050-b7b4-4ef9-8eec-a13e5f854b56 req-c4d118c3-ce53-4153-959d-25ff032911d3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049700 Jun 27 21:20:50.843295 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 326/629] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:51.428218 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2243d9fb-baf7-440e-8e5d-674f04bd711c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:51.428842 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2243d9fb-baf7-440e-8e5d-674f04bd711c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:51.442003 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2243d9fb-baf7-440e-8e5d-674f04bd711c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:51.442746 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2243d9fb-baf7-440e-8e5d-674f04bd711c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:51.443765 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2243d9fb-baf7-440e-8e5d-674f04bd711c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:51.444290 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2243d9fb-baf7-440e-8e5d-674f04bd711c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:51.541043 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2243d9fb-baf7-440e-8e5d-674f04bd711c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:51.560631 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2243d9fb-baf7-440e-8e5d-674f04bd711c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9" status: 200 len: 1325 microversion: 2.1 time: 0.135921 Jun 27 21:20:51.562100 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 304/630] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:51 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 => generated 1325 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:20:51.833348 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b20ac81c-00b9-481a-a6c5-0116920132fd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:51.834941 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b20ac81c-00b9-481a-a6c5-0116920132fd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] [instance: 53419a08-6ab0-4f25-82f9-81496ca7440e] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:51.845133 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b20ac81c-00b9-481a-a6c5-0116920132fd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:51.845662 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b20ac81c-00b9-481a-a6c5-0116920132fd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:51.846496 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b20ac81c-00b9-481a-a6c5-0116920132fd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:51.846980 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b20ac81c-00b9-481a-a6c5-0116920132fd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:51.864510 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-b20ac81c-00b9-481a-a6c5-0116920132fd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] HTTP exception thrown: Instance 53419a08-6ab0-4f25-82f9-81496ca7440e could not be found. Jun 27 21:20:51.866206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b20ac81c-00b9-481a-a6c5-0116920132fd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Request method failure captured: Jun 27 21:20:51.866206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e HTTP/1.1 Jun 27 21:20:51.866206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:20:51.866206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:20:51.866206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:20:51.866206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:20:51.866206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:20:51.866206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:20:51.866206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:20:51.866206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:20:51.866206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh4MtCUDYlYQAgDha4AvmudCjuvwvHIGW1y1KgJ39KrW_dqcQEVlDzD-XMR-AlLP_0KAJKcuGUS2Ns8xi3pVbviq_M178w8YodWUnffgx7-aVG6aPoo5C66rO-fFAe_0HQHN6yZX1qOaX4CMMRqy5foO5lwLx89IL8-rGKilhGX1QM8 Jun 27 21:20:51.866206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:20:51.866206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:20:51.866206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:20:51.866206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:20:51.866206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:20:51.866206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:20:51.866206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: a2a3853bab51428eb89ff228e5f29ef4 Jun 27 21:20:51.866206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2086275792 Jun 27 21:20:51.866206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:20:51.866206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:20:51.867879 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a2a3853bab51428eb89ff228e5f29ef4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a2a3853bab51428eb89ff228e5f29ef4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a2a3853bab51428eb89ff228e5f29ef4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a2a3853bab51428eb89ff228e5f29ef4"}]}] Jun 27 21:20:51.867879 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2086275792 Jun 27 21:20:51.867879 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: a2a3853bab51428eb89ff228e5f29ef4 Jun 27 21:20:51.867879 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2086275792 Jun 27 21:20:51.867879 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-ServerRescueNegativeTestJSON-2086275792-project Jun 27 21:20:51.867879 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:20:51.867879 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:20:51.867879 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: a0408ee5961249d1bd296a6ef1a030a9 Jun 27 21:20:51.867879 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2086275792-project Jun 27 21:20:51.867879 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: > Jun 27 21:20:51.867879 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Instance 53419a08-6ab0-4f25-82f9-81496ca7440e could not be found. Jun 27 21:20:51.867879 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'id': '53419a08-6ab0-4f25-82f9-81496ca7440e'} Jun 27 21:20:51.869020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:20:51.869020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:51.869020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:20:51.869020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:20:51.869020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:20:51.869020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:20:51.869020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:20:51.869020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:20:51.869020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:20:51.869020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:20:51.869020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53419a08-6ab0-4f25-82f9-81496ca7440e could not be found. Jun 27 21:20:51.869020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:20:51.869020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:20:51.869020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:20:51.869020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:51.869020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:20:51.869020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:20:51.869020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:20:51.869020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:20:51.869020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:20:51.870431 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:20:51.870431 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:20:51.870431 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:20:51.870431 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:20:51.870431 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:20:51.870431 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:20:51.870431 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:20:51.870431 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53419a08-6ab0-4f25-82f9-81496ca7440e could not be found. Jun 27 21:20:51.870431 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:20:51.870431 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:20:51.870431 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:20:51.870431 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:51.870431 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:20:51.870431 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:20:51.870431 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:20:51.870431 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:20:51.870431 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53419a08-6ab0-4f25-82f9-81496ca7440e could not be found. Jun 27 21:20:51.870431 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:20:51.871737 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b20ac81c-00b9-481a-a6c5-0116920132fd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] Returning 404 to user: Instance 53419a08-6ab0-4f25-82f9-81496ca7440e could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:20:51.871737 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b20ac81c-00b9-481a-a6c5-0116920132fd tempest-ServerRescueNegativeTestJSON-2086275792 tempest-ServerRescueNegativeTestJSON-2086275792-project] 10.222.0.13 "GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e" status: 404 len: 111 microversion: 2.1 time: 0.039411 Jun 27 21:20:51.871920 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 327/631] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:51 2022] GET /compute/v2.1/servers/53419a08-6ab0-4f25-82f9-81496ca7440e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:20:52.583223 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ad6fbec1-cfb8-4526-ade2-7af10a95a6f3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:52.584517 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ad6fbec1-cfb8-4526-ade2-7af10a95a6f3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:52.596108 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad6fbec1-cfb8-4526-ade2-7af10a95a6f3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:52.596868 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad6fbec1-cfb8-4526-ade2-7af10a95a6f3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:52.598219 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad6fbec1-cfb8-4526-ade2-7af10a95a6f3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:52.598950 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad6fbec1-cfb8-4526-ade2-7af10a95a6f3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:52.617377 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-ad6fbec1-cfb8-4526-ade2-7af10a95a6f3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] HTTP exception thrown: Instance 397198b2-1a3a-4947-8184-2f3c7a817da9 could not be found. Jun 27 21:20:52.619505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ad6fbec1-cfb8-4526-ade2-7af10a95a6f3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Request method failure captured: Jun 27 21:20:52.619505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 HTTP/1.1 Jun 27 21:20:52.619505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:20:52.619505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:20:52.619505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:20:52.619505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:20:52.619505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:20:52.619505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:20:52.619505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:20:52.619505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:20:52.619505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh4YqTj0KDKiAA8-Ybj3-gdHviC0IY0gRPX_-zc843y94FxFezSOatXJ1qtJsvtWNZXTTXRx1zonPA_7MuDBpdKOf2Im45jkxvzu24Ha4gAYEuaWcvZ6e6-OgMyPsQ6l_aEAmdX7x7dpM8AjaVFtaQBsb85u09RPN7A4hzw049NiIF4 Jun 27 21:20:52.619505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:20:52.619505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:20:52.619505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:20:52.619505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:20:52.619505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:20:52.619505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:20:52.619505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:20:52.619505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:20:52.619505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:20:52.619505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:20:52.621994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a74724882c84e8f893f5be0f59a9581", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}] Jun 27 21:20:52.621994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:20:52.621994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:20:52.621994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:20:52.621994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:20:52.621994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:20:52.621994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:20:52.621994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: fff9f1fc84a54b83a7a384965f40c9d9 Jun 27 21:20:52.621994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:20:52.621994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:20:52.621994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance 397198b2-1a3a-4947-8184-2f3c7a817da9 could not be found. Jun 27 21:20:52.621994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '397198b2-1a3a-4947-8184-2f3c7a817da9'} Jun 27 21:20:52.623344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:20:52.623344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:52.623344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:20:52.623344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:20:52.623344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:20:52.623344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:20:52.623344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:20:52.623344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:20:52.623344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:20:52.623344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:20:52.623344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 397198b2-1a3a-4947-8184-2f3c7a817da9 could not be found. Jun 27 21:20:52.623344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:20:52.623344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:20:52.623344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:20:52.623344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:52.623344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:20:52.623344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:20:52.623344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:20:52.623344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:20:52.623344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:20:52.627209 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:20:52.627209 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:20:52.627209 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:20:52.627209 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:20:52.627209 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:20:52.627209 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:20:52.627209 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:20:52.627209 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 397198b2-1a3a-4947-8184-2f3c7a817da9 could not be found. Jun 27 21:20:52.627209 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:20:52.627209 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:20:52.627209 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:20:52.627209 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:52.627209 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:20:52.627209 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:20:52.627209 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:20:52.627209 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:20:52.627209 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 397198b2-1a3a-4947-8184-2f3c7a817da9 could not be found. Jun 27 21:20:52.627209 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:20:52.630464 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ad6fbec1-cfb8-4526-ade2-7af10a95a6f3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Returning 404 to user: Instance 397198b2-1a3a-4947-8184-2f3c7a817da9 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:20:52.630464 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ad6fbec1-cfb8-4526-ade2-7af10a95a6f3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9" status: 404 len: 111 microversion: 2.1 time: 0.045400 Jun 27 21:20:52.630464 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 305/632] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:52 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:20:52.632747 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a1826eed-0127-4ec9-a420-fa8153cdbe62 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '.version_select at 0x7f834f1c49d0>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:52.655862 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a1826eed-0127-4ec9-a420-fa8153cdbe62 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-549687424" status: 202 len: 0 microversion: 2.1 time: 0.028799 Jun 27 21:20:52.659902 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 328/633] 10.222.0.13 () {58 vars in 1217 bytes} [Mon Jun 27 21:20:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-549687424 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:20:52.970741 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-f26de284-e5ad-4d39-861e-6164367dd1cd req-dce62c0d-b795-4e6e-a211-7df9eb6aeb87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397198b2-1a3a-4947-8184-2f3c7a817da9", "name": "network-vif-deleted", "tag": "614915c8-5412-4f02-82c2-94d13c38ee9b"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:52.983878 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-f26de284-e5ad-4d39-861e-6164367dd1cd req-dce62c0d-b795-4e6e-a211-7df9eb6aeb87 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:52.984621 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-f26de284-e5ad-4d39-861e-6164367dd1cd req-dce62c0d-b795-4e6e-a211-7df9eb6aeb87 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:53.005027 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-f26de284-e5ad-4d39-861e-6164367dd1cd req-dce62c0d-b795-4e6e-a211-7df9eb6aeb87 service nova] Creating event network-vif-deleted:614915c8-5412-4f02-82c2-94d13c38ee9b for instance 397198b2-1a3a-4947-8184-2f3c7a817da9 on hv-cinder-84773 Jun 27 21:20:53.014055 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-f26de284-e5ad-4d39-861e-6164367dd1cd req-dce62c0d-b795-4e6e-a211-7df9eb6aeb87 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048175 Jun 27 21:20:53.015411 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 306/634] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:53.723823 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-82a34578-7ba6-4972-b438-70aedc47057d tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Action: 'create', calling method: .version_select at 0x7f834f233d30>, body: {"keypair": {"name": "tempest-keypair-959447349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPVrIB8UjBt+CD9fl4srUwl2u64s38ZyhbrpwdbIh+L9wtxc4/71DVL8CY8/uZEAh6laOL+mRcJQW+NWzkAgrmzKi/ob02RFumORhuKw9z7my+qDgPjm98uMCGuiTf4BA=="}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:53.740910 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-82a34578-7ba6-4972-b438-70aedc47057d tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Getting quotas for project 4a74724882c84e8f893f5be0f59a9581. Resources: {'key_pairs'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:20:53.748447 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-82a34578-7ba6-4972-b438-70aedc47057d tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Getting quotas for user fff9f1fc84a54b83a7a384965f40c9d9 and project 4a74724882c84e8f893f5be0f59a9581. Resources: {'key_pairs'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:20:53.776838 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-82a34578-7ba6-4972-b438-70aedc47057d tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057198 Jun 27 21:20:53.777521 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 329/635] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 27 21:20:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:54.326984 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-aa807ef8-e2de-4e55-ac76-2fc1c7622617 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:54.328106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-aa807ef8-e2de-4e55-ac76-2fc1c7622617 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:54.347250 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aa807ef8-e2de-4e55-ac76-2fc1c7622617 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:54.350202 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aa807ef8-e2de-4e55-ac76-2fc1c7622617 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:54.352329 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aa807ef8-e2de-4e55-ac76-2fc1c7622617 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:54.353803 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aa807ef8-e2de-4e55-ac76-2fc1c7622617 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:54.399060 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-aa807ef8-e2de-4e55-ac76-2fc1c7622617 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lazy-loading 'flavor' on Instance uuid 9323a6ac-3a15-471a-b676-eb3e809a8637 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:20:54.574270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-aa807ef8-e2de-4e55-ac76-2fc1c7622617 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "POST /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637/action" status: 202 len: 0 microversion: 2.1 time: 0.255923 Jun 27 21:20:54.575735 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 307/636] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 27 21:20:54 2022] POST /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 21:20:54.590119 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-31019437-5065-4064-8460-8ec4dba0b645 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:54.591154 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-31019437-5065-4064-8460-8ec4dba0b645 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:54.611482 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-31019437-5065-4064-8460-8ec4dba0b645 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:54.613282 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-31019437-5065-4064-8460-8ec4dba0b645 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:54.615061 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-31019437-5065-4064-8460-8ec4dba0b645 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:54.615866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-31019437-5065-4064-8460-8ec4dba0b645 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:54.834381 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-31019437-5065-4064-8460-8ec4dba0b645 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:54.848180 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-31019437-5065-4064-8460-8ec4dba0b645 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1567 microversion: 2.1 time: 0.267036 Jun 27 21:20:54.849042 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 330/637] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:54 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1567 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:55.871068 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f7908545-087b-4abc-bd6a-f07f9d43f450 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:55.871803 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f7908545-087b-4abc-bd6a-f07f9d43f450 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:55.883058 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f7908545-087b-4abc-bd6a-f07f9d43f450 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:55.885051 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f7908545-087b-4abc-bd6a-f07f9d43f450 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:55.887491 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f7908545-087b-4abc-bd6a-f07f9d43f450 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:55.889585 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f7908545-087b-4abc-bd6a-f07f9d43f450 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:56.614289 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f7908545-087b-4abc-bd6a-f07f9d43f450 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:56.627367 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f7908545-087b-4abc-bd6a-f07f9d43f450 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1567 microversion: 2.1 time: 0.760614 Jun 27 21:20:56.627968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 308/638] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:55 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1567 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:56.730609 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2218c799-9239-4020-a3d3-7ebf1ac068d5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1348352294", "imageRef": "3155f228-b1ff-487e-837f-85eec68c250a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88eac9a2-e4a8-414f-a6be-c486870814c1"}], "security_groups": [{"name": "tempest-securitygroup--1763745875"}], "key_name": "tempest-keypair-959447349", "user_data": "}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:56.915575 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.network.neutron [None req-2218c799-9239-4020-a3d3-7ebf1ac068d5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] validate_networks() for [('88eac9a2-e4a8-414f-a6be-c486870814c1', None, None, None, None, None)] {{(pid=117891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:20:57.025223 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-53665cea-9ca4-4b99-a2ae-ddc1ff87ab9e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:57.025780 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-53665cea-9ca4-4b99-a2ae-ddc1ff87ab9e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:57.032806 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53665cea-9ca4-4b99-a2ae-ddc1ff87ab9e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:57.033282 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53665cea-9ca4-4b99-a2ae-ddc1ff87ab9e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:57.034052 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53665cea-9ca4-4b99-a2ae-ddc1ff87ab9e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:57.034698 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53665cea-9ca4-4b99-a2ae-ddc1ff87ab9e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:57.059508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-53665cea-9ca4-4b99-a2ae-ddc1ff87ab9e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10/ips" status: 200 len: 152 microversion: 2.20 time: 0.038647 Jun 27 21:20:57.060113 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 309/639] 10.222.0.13 () {60 vars in 1288 bytes} [Mon Jun 27 21:20:57 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 21:20:57.647349 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-781fa8ee-10fd-479f-911f-ef3882719604 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:57.648169 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-781fa8ee-10fd-479f-911f-ef3882719604 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:57.655248 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-781fa8ee-10fd-479f-911f-ef3882719604 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:57.655683 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-781fa8ee-10fd-479f-911f-ef3882719604 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:57.656710 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-781fa8ee-10fd-479f-911f-ef3882719604 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:57.657177 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-781fa8ee-10fd-479f-911f-ef3882719604 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:57.709681 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-2218c799-9239-4020-a3d3-7ebf1ac068d5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Flavor limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:20:57.710136 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-2218c799-9239-4020-a3d3-7ebf1ac068d5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Image limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:20:57.710651 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-2218c799-9239-4020-a3d3-7ebf1ac068d5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Flavor pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:20:57.711316 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-2218c799-9239-4020-a3d3-7ebf1ac068d5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Image pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:20:57.712053 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-2218c799-9239-4020-a3d3-7ebf1ac068d5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:20:57.735195 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2218c799-9239-4020-a3d3-7ebf1ac068d5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:57.735943 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2218c799-9239-4020-a3d3-7ebf1ac068d5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:57.737287 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2218c799-9239-4020-a3d3-7ebf1ac068d5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:57.737887 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2218c799-9239-4020-a3d3-7ebf1ac068d5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:57.766331 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-2218c799-9239-4020-a3d3-7ebf1ac068d5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Getting quotas for project 4a74724882c84e8f893f5be0f59a9581. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:20:57.772293 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-2218c799-9239-4020-a3d3-7ebf1ac068d5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Getting quotas for user fff9f1fc84a54b83a7a384965f40c9d9 and project 4a74724882c84e8f893f5be0f59a9581. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:20:57.789402 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2218c799-9239-4020-a3d3-7ebf1ac068d5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Going to run 1 instances... {{(pid=117891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:20:57.793060 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2218c799-9239-4020-a3d3-7ebf1ac068d5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3155f228-b1ff-487e-837f-85eec68c250a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:20:57.842976 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2218c799-9239-4020-a3d3-7ebf1ac068d5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.118109 Jun 27 21:20:57.844190 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 331/640] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 27 21:20:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:20:57.855700 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-02d3099f-2d97-4d67-aeff-30083cffb109 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:57.856882 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-02d3099f-2d97-4d67-aeff-30083cffb109 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:57.890430 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-781fa8ee-10fd-479f-911f-ef3882719604 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:57.904410 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-781fa8ee-10fd-479f-911f-ef3882719604 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1567 microversion: 2.1 time: 0.260632 Jun 27 21:20:57.905934 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 310/641] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:57 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:20:57.939370 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-02d3099f-2d97-4d67-aeff-30083cffb109 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:57.954073 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-02d3099f-2d97-4d67-aeff-30083cffb109 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68" status: 200 len: 1241 microversion: 2.1 time: 0.102171 Jun 27 21:20:57.963524 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 332/642] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:57 2022] GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68 => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:20:58.939697 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-421c2d81-4e9b-452a-badd-3e7442f633ef tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:58.940527 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-421c2d81-4e9b-452a-badd-3e7442f633ef tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:58.947819 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-421c2d81-4e9b-452a-badd-3e7442f633ef tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:58.948261 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-421c2d81-4e9b-452a-badd-3e7442f633ef tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:58.949068 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-421c2d81-4e9b-452a-badd-3e7442f633ef tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:58.949489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-421c2d81-4e9b-452a-badd-3e7442f633ef tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:58.971588 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-38ef3ae3-ab88-4c08-a08c-1398729b721c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:58.971588 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-38ef3ae3-ab88-4c08-a08c-1398729b721c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:58.977161 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:58.979662 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-38ef3ae3-ab88-4c08-a08c-1398729b721c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:58.980092 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-38ef3ae3-ab88-4c08-a08c-1398729b721c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:58.986002 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-38ef3ae3-ab88-4c08-a08c-1398729b721c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:58.990610 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-38ef3ae3-ab88-4c08-a08c-1398729b721c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:59.104701 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-38ef3ae3-ab88-4c08-a08c-1398729b721c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:59.118409 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-38ef3ae3-ab88-4c08-a08c-1398729b721c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68" status: 200 len: 1293 microversion: 2.1 time: 0.151280 Jun 27 21:20:59.120038 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 333/643] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:58 2022] GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68 => generated 1293 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:20:59.271320 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-421c2d81-4e9b-452a-badd-3e7442f633ef tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:59.282573 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-421c2d81-4e9b-452a-badd-3e7442f633ef tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1567 microversion: 2.1 time: 0.346653 Jun 27 21:20:59.283470 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 311/644] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:58 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1567 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:59.823533 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d86da2ca-dea7-488e-878d-050597e207ae tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:59.824503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d86da2ca-dea7-488e-878d-050597e207ae tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:59.832643 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d86da2ca-dea7-488e-878d-050597e207ae tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:59.833231 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d86da2ca-dea7-488e-878d-050597e207ae tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:59.835099 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d86da2ca-dea7-488e-878d-050597e207ae tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:59.835612 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d86da2ca-dea7-488e-878d-050597e207ae tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:59.865871 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-d86da2ca-dea7-488e-878d-050597e207ae tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lazy-loading 'flavor' on Instance uuid a775668d-41e5-407f-ad33-a3b265985d10 {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:21:00.149859 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2e2180e7-f3f1-4ab5-be26-b0322e90d37f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:00.151991 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2e2180e7-f3f1-4ab5-be26-b0322e90d37f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:00.166937 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e2180e7-f3f1-4ab5-be26-b0322e90d37f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:00.167700 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e2180e7-f3f1-4ab5-be26-b0322e90d37f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:00.169560 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e2180e7-f3f1-4ab5-be26-b0322e90d37f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:00.170304 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e2180e7-f3f1-4ab5-be26-b0322e90d37f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:00.196184 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d86da2ca-dea7-488e-878d-050597e207ae tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "POST /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10/action" status: 202 len: 0 microversion: 2.20 time: 0.376899 Jun 27 21:21:00.202813 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 334/645] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jun 27 21:20:59 2022] POST /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 27 21:21:00.209663 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2b2d25ab-f3b5-4610-ae54-8301a5a7fb17 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:00.210369 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2b2d25ab-f3b5-4610-ae54-8301a5a7fb17 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:00.236716 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2b2d25ab-f3b5-4610-ae54-8301a5a7fb17 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:00.237272 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2b2d25ab-f3b5-4610-ae54-8301a5a7fb17 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:00.239846 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2b2d25ab-f3b5-4610-ae54-8301a5a7fb17 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:00.240296 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2b2d25ab-f3b5-4610-ae54-8301a5a7fb17 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:00.386915 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2e2180e7-f3f1-4ab5-be26-b0322e90d37f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:00.404578 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2e2180e7-f3f1-4ab5-be26-b0322e90d37f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68" status: 200 len: 1299 microversion: 2.1 time: 0.270540 Jun 27 21:21:00.407111 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 312/646] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:00 2022] GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68 => generated 1299 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:21:00.419154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-50d669e7-3b59-4124-8ad9-138d58b7adf5 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:00.421434 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-50d669e7-3b59-4124-8ad9-138d58b7adf5 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:00.439578 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-50d669e7-3b59-4124-8ad9-138d58b7adf5 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:00.440980 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-50d669e7-3b59-4124-8ad9-138d58b7adf5 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:00.444370 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-50d669e7-3b59-4124-8ad9-138d58b7adf5 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:00.446082 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-50d669e7-3b59-4124-8ad9-138d58b7adf5 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:00.480837 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2b2d25ab-f3b5-4610-ae54-8301a5a7fb17 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:00.497621 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2b2d25ab-f3b5-4610-ae54-8301a5a7fb17 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:00.501106 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2b2d25ab-f3b5-4610-ae54-8301a5a7fb17 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:00.505140 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2b2d25ab-f3b5-4610-ae54-8301a5a7fb17 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1721 microversion: 2.20 time: 0.299890 Jun 27 21:21:00.506024 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 335/647] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:00 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1721 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:00.876547 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-50d669e7-3b59-4124-8ad9-138d58b7adf5 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:00.906582 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-50d669e7-3b59-4124-8ad9-138d58b7adf5 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1567 microversion: 2.1 time: 0.497549 Jun 27 21:21:00.907799 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 313/648] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:00 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1567 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:01.437272 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ee11cfc5-6a82-4949-95ed-bcf008d0c975 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:01.439780 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ee11cfc5-6a82-4949-95ed-bcf008d0c975 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:01.452540 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee11cfc5-6a82-4949-95ed-bcf008d0c975 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:01.453022 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee11cfc5-6a82-4949-95ed-bcf008d0c975 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:01.453977 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee11cfc5-6a82-4949-95ed-bcf008d0c975 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:01.454575 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee11cfc5-6a82-4949-95ed-bcf008d0c975 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:01.528506 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-728f8d13-174a-471e-9fbe-80a1e3f47543 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:01.529246 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-728f8d13-174a-471e-9fbe-80a1e3f47543 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:01.540342 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-728f8d13-174a-471e-9fbe-80a1e3f47543 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:01.540799 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-728f8d13-174a-471e-9fbe-80a1e3f47543 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:01.541937 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-728f8d13-174a-471e-9fbe-80a1e3f47543 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:01.542547 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-728f8d13-174a-471e-9fbe-80a1e3f47543 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:01.694375 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ee11cfc5-6a82-4949-95ed-bcf008d0c975 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:01.706293 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ee11cfc5-6a82-4949-95ed-bcf008d0c975 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68" status: 200 len: 1367 microversion: 2.1 time: 0.278352 Jun 27 21:21:01.717461 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 336/649] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:01 2022] GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68 => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:01.722569 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-b7bc93c5-76fc-4bd0-8632-bb0b3c6a77e3 req-31b8d964-803a-45dd-abf5-c791224d9431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eba84d8-7b64-46aa-94f3-8a58871b0c68", "tag": "cd12e24f-8f5a-4809-bb58-743542a1d988"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:01.740492 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-b7bc93c5-76fc-4bd0-8632-bb0b3c6a77e3 req-31b8d964-803a-45dd-abf5-c791224d9431 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:01.741270 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-b7bc93c5-76fc-4bd0-8632-bb0b3c6a77e3 req-31b8d964-803a-45dd-abf5-c791224d9431 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:01.760222 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-b7bc93c5-76fc-4bd0-8632-bb0b3c6a77e3 req-31b8d964-803a-45dd-abf5-c791224d9431 service nova] Creating event network-changed:cd12e24f-8f5a-4809-bb58-743542a1d988 for instance 3eba84d8-7b64-46aa-94f3-8a58871b0c68 on hv-cinder-84773 Jun 27 21:21:01.765983 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-b7bc93c5-76fc-4bd0-8632-bb0b3c6a77e3 req-31b8d964-803a-45dd-abf5-c791224d9431 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046888 Jun 27 21:21:01.766945 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 337/650] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:01.838939 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-728f8d13-174a-471e-9fbe-80a1e3f47543 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:01.851345 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-728f8d13-174a-471e-9fbe-80a1e3f47543 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:01.857582 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-728f8d13-174a-471e-9fbe-80a1e3f47543 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:01.858760 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-728f8d13-174a-471e-9fbe-80a1e3f47543 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1721 microversion: 2.20 time: 0.336667 Jun 27 21:21:01.859361 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 314/651] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:01 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1721 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:21:01.936051 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-09e0e937-09f4-4a41-b0d4-20a2a6c17c84 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:01.936756 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-09e0e937-09f4-4a41-b0d4-20a2a6c17c84 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:01.947335 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-09e0e937-09f4-4a41-b0d4-20a2a6c17c84 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:01.947776 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-09e0e937-09f4-4a41-b0d4-20a2a6c17c84 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:01.949857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-09e0e937-09f4-4a41-b0d4-20a2a6c17c84 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:01.950340 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-09e0e937-09f4-4a41-b0d4-20a2a6c17c84 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:02.275734 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-09e0e937-09f4-4a41-b0d4-20a2a6c17c84 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:02.286376 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-09e0e937-09f4-4a41-b0d4-20a2a6c17c84 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1567 microversion: 2.1 time: 0.355474 Jun 27 21:21:02.287639 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 338/652] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:01 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1567 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:02.726446 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0954d02f-2cbd-4011-80fd-58ffae614f2c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:02.727519 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0954d02f-2cbd-4011-80fd-58ffae614f2c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:02.737308 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0954d02f-2cbd-4011-80fd-58ffae614f2c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:02.738727 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0954d02f-2cbd-4011-80fd-58ffae614f2c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:02.740164 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0954d02f-2cbd-4011-80fd-58ffae614f2c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:02.740912 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0954d02f-2cbd-4011-80fd-58ffae614f2c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:02.880294 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e25c1391-f4ec-4707-a1f1-280fb72b63c5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:02.880908 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e25c1391-f4ec-4707-a1f1-280fb72b63c5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:02.889872 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e25c1391-f4ec-4707-a1f1-280fb72b63c5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:02.890315 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e25c1391-f4ec-4707-a1f1-280fb72b63c5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:02.891117 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e25c1391-f4ec-4707-a1f1-280fb72b63c5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:02.891769 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e25c1391-f4ec-4707-a1f1-280fb72b63c5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:02.985652 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0954d02f-2cbd-4011-80fd-58ffae614f2c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:02.991486 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:02.999584 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0954d02f-2cbd-4011-80fd-58ffae614f2c tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68" status: 200 len: 1367 microversion: 2.1 time: 0.276780 Jun 27 21:21:03.001497 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 315/653] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:02 2022] GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68 => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:03.057325 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e25c1391-f4ec-4707-a1f1-280fb72b63c5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:03.066429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e25c1391-f4ec-4707-a1f1-280fb72b63c5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:03.067922 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e25c1391-f4ec-4707-a1f1-280fb72b63c5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:03.069151 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e25c1391-f4ec-4707-a1f1-280fb72b63c5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1721 microversion: 2.20 time: 0.192953 Jun 27 21:21:03.070263 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 339/654] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:02 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:03.307361 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7617a120-a714-47e1-884b-ad93364b58f7 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:03.308003 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7617a120-a714-47e1-884b-ad93364b58f7 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:03.315417 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7617a120-a714-47e1-884b-ad93364b58f7 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:03.316161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7617a120-a714-47e1-884b-ad93364b58f7 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:03.317575 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7617a120-a714-47e1-884b-ad93364b58f7 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:03.318166 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7617a120-a714-47e1-884b-ad93364b58f7 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:03.562805 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7617a120-a714-47e1-884b-ad93364b58f7 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:03.571330 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7617a120-a714-47e1-884b-ad93364b58f7 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1567 microversion: 2.1 time: 0.269140 Jun 27 21:21:03.581667 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 316/655] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:03 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1567 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:04.023302 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f3d8b368-45a5-4bc1-9fea-4c89236688b9 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:04.024497 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f3d8b368-45a5-4bc1-9fea-4c89236688b9 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:04.036989 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f3d8b368-45a5-4bc1-9fea-4c89236688b9 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:04.037972 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f3d8b368-45a5-4bc1-9fea-4c89236688b9 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:04.039611 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f3d8b368-45a5-4bc1-9fea-4c89236688b9 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:04.040411 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f3d8b368-45a5-4bc1-9fea-4c89236688b9 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:04.090377 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-71e97410-98de-4735-8298-028b77c520e6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:04.091415 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-71e97410-98de-4735-8298-028b77c520e6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:04.099093 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-71e97410-98de-4735-8298-028b77c520e6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:04.100291 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-71e97410-98de-4735-8298-028b77c520e6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:04.101284 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-71e97410-98de-4735-8298-028b77c520e6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:04.102480 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-71e97410-98de-4735-8298-028b77c520e6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:04.211233 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f3d8b368-45a5-4bc1-9fea-4c89236688b9 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:04.220318 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f3d8b368-45a5-4bc1-9fea-4c89236688b9 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68" status: 200 len: 1367 microversion: 2.1 time: 0.200989 Jun 27 21:21:04.221741 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 340/656] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:04 2022] GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:04.267827 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-71e97410-98de-4735-8298-028b77c520e6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:04.284985 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-71e97410-98de-4735-8298-028b77c520e6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:04.287913 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-71e97410-98de-4735-8298-028b77c520e6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:04.289839 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-71e97410-98de-4735-8298-028b77c520e6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1721 microversion: 2.20 time: 0.205755 Jun 27 21:21:04.290724 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 317/657] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:04 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:21:04.589801 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4111b940-e831-4eeb-a995-ee5fd366b1fa tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:04.590420 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4111b940-e831-4eeb-a995-ee5fd366b1fa tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:04.597585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4111b940-e831-4eeb-a995-ee5fd366b1fa tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:04.598049 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4111b940-e831-4eeb-a995-ee5fd366b1fa tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:04.599005 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4111b940-e831-4eeb-a995-ee5fd366b1fa tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:04.599455 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4111b940-e831-4eeb-a995-ee5fd366b1fa tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:04.784886 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4111b940-e831-4eeb-a995-ee5fd366b1fa tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:04.793399 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4111b940-e831-4eeb-a995-ee5fd366b1fa tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1567 microversion: 2.1 time: 0.207988 Jun 27 21:21:04.794253 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 341/658] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:04 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:05.240839 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0bddf2ca-bdf1-4c96-9b1f-83e70d4221c5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:05.242040 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0bddf2ca-bdf1-4c96-9b1f-83e70d4221c5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:05.256120 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0bddf2ca-bdf1-4c96-9b1f-83e70d4221c5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:05.256795 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0bddf2ca-bdf1-4c96-9b1f-83e70d4221c5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:05.258217 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0bddf2ca-bdf1-4c96-9b1f-83e70d4221c5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:05.259171 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0bddf2ca-bdf1-4c96-9b1f-83e70d4221c5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:05.311625 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b3c48be8-9a3b-45cc-a9ce-168b242ecbed tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:05.312326 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b3c48be8-9a3b-45cc-a9ce-168b242ecbed tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:05.320115 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b3c48be8-9a3b-45cc-a9ce-168b242ecbed tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:05.321124 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b3c48be8-9a3b-45cc-a9ce-168b242ecbed tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:05.322381 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b3c48be8-9a3b-45cc-a9ce-168b242ecbed tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:05.323012 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b3c48be8-9a3b-45cc-a9ce-168b242ecbed tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:05.484061 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b3c48be8-9a3b-45cc-a9ce-168b242ecbed tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:05.487566 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:05.498904 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b3c48be8-9a3b-45cc-a9ce-168b242ecbed tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:05.500457 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b3c48be8-9a3b-45cc-a9ce-168b242ecbed tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:05.501685 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b3c48be8-9a3b-45cc-a9ce-168b242ecbed tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1721 microversion: 2.20 time: 0.195750 Jun 27 21:21:05.505238 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 342/659] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:05 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:21:05.509445 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0bddf2ca-bdf1-4c96-9b1f-83e70d4221c5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:05.522536 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0bddf2ca-bdf1-4c96-9b1f-83e70d4221c5 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68" status: 200 len: 1367 microversion: 2.1 time: 0.287548 Jun 27 21:21:05.529783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 318/660] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:05 2022] GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68 => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:05.811139 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-06ad6283-7463-42d9-aba6-611a7fb99e1b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:05.811852 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-06ad6283-7463-42d9-aba6-611a7fb99e1b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:05.819344 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-06ad6283-7463-42d9-aba6-611a7fb99e1b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:05.819793 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-06ad6283-7463-42d9-aba6-611a7fb99e1b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:05.820561 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-06ad6283-7463-42d9-aba6-611a7fb99e1b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:05.821011 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-06ad6283-7463-42d9-aba6-611a7fb99e1b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:05.990186 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-06ad6283-7463-42d9-aba6-611a7fb99e1b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:05.998024 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-06ad6283-7463-42d9-aba6-611a7fb99e1b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1567 microversion: 2.1 time: 0.190784 Jun 27 21:21:05.998605 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 343/661] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:05 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:06.534288 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-36822f8a-bd6b-441e-a250-9cf9690d18d7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:06.535303 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-36822f8a-bd6b-441e-a250-9cf9690d18d7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:06.540095 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-806e1dd7-89b2-4e4a-80a5-d7432092ca37 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:06.541426 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-806e1dd7-89b2-4e4a-80a5-d7432092ca37 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:06.543071 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-36822f8a-bd6b-441e-a250-9cf9690d18d7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:06.543526 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-36822f8a-bd6b-441e-a250-9cf9690d18d7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:06.544325 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-36822f8a-bd6b-441e-a250-9cf9690d18d7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:06.544857 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-36822f8a-bd6b-441e-a250-9cf9690d18d7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:06.552642 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-806e1dd7-89b2-4e4a-80a5-d7432092ca37 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:06.553139 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-806e1dd7-89b2-4e4a-80a5-d7432092ca37 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:06.554269 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-806e1dd7-89b2-4e4a-80a5-d7432092ca37 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:06.554737 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-806e1dd7-89b2-4e4a-80a5-d7432092ca37 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:06.759460 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-806e1dd7-89b2-4e4a-80a5-d7432092ca37 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:06.773715 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-806e1dd7-89b2-4e4a-80a5-d7432092ca37 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68" status: 200 len: 1367 microversion: 2.1 time: 0.237501 Jun 27 21:21:06.774813 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 344/662] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:06 2022] GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:21:06.961065 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-d51b6255-c300-44c7-9c3b-7c3f0956d09d req-f3c2b7d7-e7d5-4daf-8e9d-ece2ee168788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eba84d8-7b64-46aa-94f3-8a58871b0c68", "name": "network-vif-plugged", "status": "completed", "tag": "cd12e24f-8f5a-4809-bb58-743542a1d988"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:06.974701 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-d51b6255-c300-44c7-9c3b-7c3f0956d09d req-f3c2b7d7-e7d5-4daf-8e9d-ece2ee168788 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:06.975269 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-d51b6255-c300-44c7-9c3b-7c3f0956d09d req-f3c2b7d7-e7d5-4daf-8e9d-ece2ee168788 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:07.011944 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-d51b6255-c300-44c7-9c3b-7c3f0956d09d req-f3c2b7d7-e7d5-4daf-8e9d-ece2ee168788 service nova] Creating event network-vif-plugged:cd12e24f-8f5a-4809-bb58-743542a1d988 for instance 3eba84d8-7b64-46aa-94f3-8a58871b0c68 on hv-cinder-84773 Jun 27 21:21:07.029016 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-36822f8a-bd6b-441e-a250-9cf9690d18d7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:07.030117 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-d51b6255-c300-44c7-9c3b-7c3f0956d09d req-f3c2b7d7-e7d5-4daf-8e9d-ece2ee168788 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075822 Jun 27 21:21:07.031873 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 345/663] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:07.037512 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-36822f8a-bd6b-441e-a250-9cf9690d18d7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:07.039014 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-36822f8a-bd6b-441e-a250-9cf9690d18d7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:07.040318 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-36822f8a-bd6b-441e-a250-9cf9690d18d7 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1721 microversion: 2.20 time: 0.510039 Jun 27 21:21:07.041275 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 319/664] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:06 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1721 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:07.042469 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-78b1dd21-2998-4ea1-aa09-b6bdcc84d06a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:07.043966 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-78b1dd21-2998-4ea1-aa09-b6bdcc84d06a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:07.058151 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-78b1dd21-2998-4ea1-aa09-b6bdcc84d06a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:07.058953 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-78b1dd21-2998-4ea1-aa09-b6bdcc84d06a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:07.060627 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-78b1dd21-2998-4ea1-aa09-b6bdcc84d06a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:07.061160 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-78b1dd21-2998-4ea1-aa09-b6bdcc84d06a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:07.227036 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-78b1dd21-2998-4ea1-aa09-b6bdcc84d06a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:07.235724 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-78b1dd21-2998-4ea1-aa09-b6bdcc84d06a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1567 microversion: 2.1 time: 0.201829 Jun 27 21:21:07.236341 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 346/665] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:07 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:07.797899 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e0660dd5-6803-4b42-bbea-c1612fbde043 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:07.798927 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e0660dd5-6803-4b42-bbea-c1612fbde043 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:07.811160 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e0660dd5-6803-4b42-bbea-c1612fbde043 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:07.812071 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e0660dd5-6803-4b42-bbea-c1612fbde043 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:07.813414 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e0660dd5-6803-4b42-bbea-c1612fbde043 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:07.814185 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e0660dd5-6803-4b42-bbea-c1612fbde043 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:07.992283 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e0660dd5-6803-4b42-bbea-c1612fbde043 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:08.003137 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e0660dd5-6803-4b42-bbea-c1612fbde043 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68" status: 200 len: 1367 microversion: 2.1 time: 0.213710 Jun 27 21:21:08.003981 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 320/666] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:07 2022] GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:08.059405 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:08.062012 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=12 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:08.070741 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ff1c737c-22c0-40ce-a3cd-362a04535287 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:08.072273 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ff1c737c-22c0-40ce-a3cd-362a04535287 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:08.085954 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ff1c737c-22c0-40ce-a3cd-362a04535287 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:08.086903 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ff1c737c-22c0-40ce-a3cd-362a04535287 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:08.089286 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ff1c737c-22c0-40ce-a3cd-362a04535287 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:08.089286 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ff1c737c-22c0-40ce-a3cd-362a04535287 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:08.243826 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ff1c737c-22c0-40ce-a3cd-362a04535287 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:08.254489 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ff1c737c-22c0-40ce-a3cd-362a04535287 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:08.257848 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ff1c737c-22c0-40ce-a3cd-362a04535287 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:08.260184 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ff1c737c-22c0-40ce-a3cd-362a04535287 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1721 microversion: 2.20 time: 0.203388 Jun 27 21:21:08.261260 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 347/667] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:08 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:08.263145 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-feab8f9f-df9a-418d-a251-dd95b597c94c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:08.263964 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-feab8f9f-df9a-418d-a251-dd95b597c94c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:08.272677 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-feab8f9f-df9a-418d-a251-dd95b597c94c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:08.273783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-feab8f9f-df9a-418d-a251-dd95b597c94c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:08.275053 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-feab8f9f-df9a-418d-a251-dd95b597c94c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:08.275823 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-feab8f9f-df9a-418d-a251-dd95b597c94c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:08.464010 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-feab8f9f-df9a-418d-a251-dd95b597c94c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:08.482497 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-feab8f9f-df9a-418d-a251-dd95b597c94c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1568 microversion: 2.1 time: 0.226160 Jun 27 21:21:08.485103 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 321/668] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:08 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:08.505924 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0d9c0808-0a58-46c3-80a5-a2b1ecf7e897 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:08.507939 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0d9c0808-0a58-46c3-80a5-a2b1ecf7e897 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:08.521036 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0d9c0808-0a58-46c3-80a5-a2b1ecf7e897 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:08.521834 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0d9c0808-0a58-46c3-80a5-a2b1ecf7e897 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:08.523225 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0d9c0808-0a58-46c3-80a5-a2b1ecf7e897 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:08.523983 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0d9c0808-0a58-46c3-80a5-a2b1ecf7e897 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:08.638251 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0d9c0808-0a58-46c3-80a5-a2b1ecf7e897 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "POST /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637/action" status: 202 len: 0 microversion: 2.1 time: 0.140934 Jun 27 21:21:08.638981 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 348/669] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 27 21:21:08 2022] POST /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:21:08.647389 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-88f32af9-9dab-4da3-98c4-e7ce70a522fd tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:08.648195 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-88f32af9-9dab-4da3-98c4-e7ce70a522fd tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:08.655936 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88f32af9-9dab-4da3-98c4-e7ce70a522fd tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:08.656469 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88f32af9-9dab-4da3-98c4-e7ce70a522fd tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:08.657364 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88f32af9-9dab-4da3-98c4-e7ce70a522fd tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:08.657872 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88f32af9-9dab-4da3-98c4-e7ce70a522fd tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:08.825596 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-88f32af9-9dab-4da3-98c4-e7ce70a522fd tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:08.834376 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-88f32af9-9dab-4da3-98c4-e7ce70a522fd tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1576 microversion: 2.1 time: 0.190559 Jun 27 21:21:08.834966 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 322/670] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:08 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:09.022800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-64dcf7d5-a348-4f58-9b89-8af7ee881472 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:09.023573 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-64dcf7d5-a348-4f58-9b89-8af7ee881472 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:09.030543 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-64dcf7d5-a348-4f58-9b89-8af7ee881472 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:09.031059 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-64dcf7d5-a348-4f58-9b89-8af7ee881472 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:09.031810 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-64dcf7d5-a348-4f58-9b89-8af7ee881472 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:09.032240 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-64dcf7d5-a348-4f58-9b89-8af7ee881472 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:09.257235 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-64dcf7d5-a348-4f58-9b89-8af7ee881472 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:09.266966 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-64dcf7d5-a348-4f58-9b89-8af7ee881472 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68" status: 200 len: 1557 microversion: 2.1 time: 0.248317 Jun 27 21:21:09.267973 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 349/671] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:09 2022] GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68 => generated 1557 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:09.283039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-80c32090-3e50-4d45-8323-658317c2a42b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:09.283681 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-80c32090-3e50-4d45-8323-658317c2a42b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:09.285680 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9f8e32db-f480-4e13-a2a3-610b165028b2 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:09.286224 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9f8e32db-f480-4e13-a2a3-610b165028b2 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:09.292003 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-80c32090-3e50-4d45-8323-658317c2a42b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:09.292471 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-80c32090-3e50-4d45-8323-658317c2a42b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:09.293236 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9f8e32db-f480-4e13-a2a3-610b165028b2 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:09.293694 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9f8e32db-f480-4e13-a2a3-610b165028b2 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:09.293831 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-80c32090-3e50-4d45-8323-658317c2a42b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:09.294143 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-80c32090-3e50-4d45-8323-658317c2a42b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:09.294782 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9f8e32db-f480-4e13-a2a3-610b165028b2 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:09.295246 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9f8e32db-f480-4e13-a2a3-610b165028b2 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:09.393278 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9f8e32db-f480-4e13-a2a3-610b165028b2 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112189 Jun 27 21:21:09.394181 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 350/672] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 27 21:21:09 2022] GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:09.556179 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-80c32090-3e50-4d45-8323-658317c2a42b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:09.568210 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-80c32090-3e50-4d45-8323-658317c2a42b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:09.570849 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-80c32090-3e50-4d45-8323-658317c2a42b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:09.572600 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-80c32090-3e50-4d45-8323-658317c2a42b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1721 microversion: 2.20 time: 0.294825 Jun 27 21:21:09.586703 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 323/673] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:09 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1721 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:09.859578 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-79721833-7a14-4c71-aa8f-c72046254d2a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:09.863491 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-79721833-7a14-4c71-aa8f-c72046254d2a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:09.879229 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-79721833-7a14-4c71-aa8f-c72046254d2a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:09.880155 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-79721833-7a14-4c71-aa8f-c72046254d2a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:09.881751 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-79721833-7a14-4c71-aa8f-c72046254d2a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:09.882431 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-79721833-7a14-4c71-aa8f-c72046254d2a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:10.091704 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-79721833-7a14-4c71-aa8f-c72046254d2a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:10.108937 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-79721833-7a14-4c71-aa8f-c72046254d2a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1518 microversion: 2.1 time: 0.257408 Jun 27 21:21:10.110798 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 351/674] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:09 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1518 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:10.596786 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e7c54986-9009-476c-af39-19138ec7a031 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:10.598364 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e7c54986-9009-476c-af39-19138ec7a031 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:10.608900 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e7c54986-9009-476c-af39-19138ec7a031 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:10.609399 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e7c54986-9009-476c-af39-19138ec7a031 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:10.610188 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e7c54986-9009-476c-af39-19138ec7a031 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:10.612839 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e7c54986-9009-476c-af39-19138ec7a031 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:10.828733 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-1658a419-4c77-4d4e-a3a8-7678ec395d6a req-caa993aa-dc19-4a12-a37d-8391ad34ed58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eba84d8-7b64-46aa-94f3-8a58871b0c68", "tag": "cd12e24f-8f5a-4809-bb58-743542a1d988"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:10.869058 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-1658a419-4c77-4d4e-a3a8-7678ec395d6a req-caa993aa-dc19-4a12-a37d-8391ad34ed58 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:10.872079 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-1658a419-4c77-4d4e-a3a8-7678ec395d6a req-caa993aa-dc19-4a12-a37d-8391ad34ed58 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:10.887486 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e7c54986-9009-476c-af39-19138ec7a031 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:10.903372 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-1658a419-4c77-4d4e-a3a8-7678ec395d6a req-caa993aa-dc19-4a12-a37d-8391ad34ed58 service nova] Creating event network-changed:cd12e24f-8f5a-4809-bb58-743542a1d988 for instance 3eba84d8-7b64-46aa-94f3-8a58871b0c68 on hv-cinder-84773 Jun 27 21:21:10.907618 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e7c54986-9009-476c-af39-19138ec7a031 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:10.911167 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-1658a419-4c77-4d4e-a3a8-7678ec395d6a req-caa993aa-dc19-4a12-a37d-8391ad34ed58 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086712 Jun 27 21:21:10.916439 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 352/675] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:21:10.918517 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e7c54986-9009-476c-af39-19138ec7a031 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:10.920782 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e7c54986-9009-476c-af39-19138ec7a031 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1721 microversion: 2.20 time: 0.329730 Jun 27 21:21:10.921777 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 324/676] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:10 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1721 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:11.131911 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d634eeea-1d46-4cbf-ab10-8245586fb385 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:11.132859 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d634eeea-1d46-4cbf-ab10-8245586fb385 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:11.141881 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d634eeea-1d46-4cbf-ab10-8245586fb385 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:11.142446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d634eeea-1d46-4cbf-ab10-8245586fb385 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:11.143326 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d634eeea-1d46-4cbf-ab10-8245586fb385 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:11.143845 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d634eeea-1d46-4cbf-ab10-8245586fb385 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:11.321649 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d634eeea-1d46-4cbf-ab10-8245586fb385 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:11.330607 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d634eeea-1d46-4cbf-ab10-8245586fb385 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1574 microversion: 2.1 time: 0.205972 Jun 27 21:21:11.331457 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 353/677] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:11 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1574 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:11.345240 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-0b93b244-6e74-4eb4-969b-b21cf5e788be req-d6cdd2e1-2a6c-4f96-80fe-2cd77d321926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9323a6ac-3a15-471a-b676-eb3e809a8637", "name": "network-vif-unplugged", "status": "completed", "tag": "36112ae1-bee5-4df6-9469-82c6af7bb1f4"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:11.369327 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-0b93b244-6e74-4eb4-969b-b21cf5e788be req-d6cdd2e1-2a6c-4f96-80fe-2cd77d321926 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:11.370120 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-0b93b244-6e74-4eb4-969b-b21cf5e788be req-d6cdd2e1-2a6c-4f96-80fe-2cd77d321926 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:11.387539 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-0b93b244-6e74-4eb4-969b-b21cf5e788be req-d6cdd2e1-2a6c-4f96-80fe-2cd77d321926 service nova] Creating event network-vif-unplugged:36112ae1-bee5-4df6-9469-82c6af7bb1f4 for instance 9323a6ac-3a15-471a-b676-eb3e809a8637 on hv-cinder-84773 Jun 27 21:21:11.394721 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-0b93b244-6e74-4eb4-969b-b21cf5e788be req-d6cdd2e1-2a6c-4f96-80fe-2cd77d321926 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055199 Jun 27 21:21:11.395992 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 325/678] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:11.942711 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3d7379c2-de2c-4aa0-afdd-8a45e4759076 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:11.943423 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3d7379c2-de2c-4aa0-afdd-8a45e4759076 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:11.955434 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3d7379c2-de2c-4aa0-afdd-8a45e4759076 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:11.957277 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3d7379c2-de2c-4aa0-afdd-8a45e4759076 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:11.959712 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3d7379c2-de2c-4aa0-afdd-8a45e4759076 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:11.962470 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3d7379c2-de2c-4aa0-afdd-8a45e4759076 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:12.188254 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3d7379c2-de2c-4aa0-afdd-8a45e4759076 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:12.200195 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3d7379c2-de2c-4aa0-afdd-8a45e4759076 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:12.202305 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3d7379c2-de2c-4aa0-afdd-8a45e4759076 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:12.203827 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3d7379c2-de2c-4aa0-afdd-8a45e4759076 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1721 microversion: 2.20 time: 0.266707 Jun 27 21:21:12.204965 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 354/679] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:11 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1721 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:12.351765 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9d1591e2-ecb9-4213-be9e-7c209c93bb4b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:12.353869 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9d1591e2-ecb9-4213-be9e-7c209c93bb4b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:12.362973 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d1591e2-ecb9-4213-be9e-7c209c93bb4b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:12.363958 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d1591e2-ecb9-4213-be9e-7c209c93bb4b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:12.365290 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d1591e2-ecb9-4213-be9e-7c209c93bb4b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:12.365971 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d1591e2-ecb9-4213-be9e-7c209c93bb4b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:12.715168 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9d1591e2-ecb9-4213-be9e-7c209c93bb4b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:12.729688 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9d1591e2-ecb9-4213-be9e-7c209c93bb4b tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1574 microversion: 2.1 time: 0.383421 Jun 27 21:21:12.731431 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 326/680] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:12 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1574 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:13.223759 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-195c5764-1e48-4ea7-be44-cb2cde85c9b4 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:13.224374 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-195c5764-1e48-4ea7-be44-cb2cde85c9b4 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:13.232642 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-195c5764-1e48-4ea7-be44-cb2cde85c9b4 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:13.233060 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-195c5764-1e48-4ea7-be44-cb2cde85c9b4 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:13.233865 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-195c5764-1e48-4ea7-be44-cb2cde85c9b4 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:13.234297 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-195c5764-1e48-4ea7-be44-cb2cde85c9b4 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:13.426629 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-195c5764-1e48-4ea7-be44-cb2cde85c9b4 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:13.436349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-195c5764-1e48-4ea7-be44-cb2cde85c9b4 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:13.438050 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-195c5764-1e48-4ea7-be44-cb2cde85c9b4 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:13.439281 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-195c5764-1e48-4ea7-be44-cb2cde85c9b4 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1721 microversion: 2.20 time: 0.219891 Jun 27 21:21:13.440196 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 355/681] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:13 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:13.749739 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fcf234a7-b90e-4fd6-8f2e-f1e6167d5dfe tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:13.750378 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fcf234a7-b90e-4fd6-8f2e-f1e6167d5dfe tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:13.758331 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fcf234a7-b90e-4fd6-8f2e-f1e6167d5dfe tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:13.758852 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fcf234a7-b90e-4fd6-8f2e-f1e6167d5dfe tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:13.759672 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fcf234a7-b90e-4fd6-8f2e-f1e6167d5dfe tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:13.760116 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fcf234a7-b90e-4fd6-8f2e-f1e6167d5dfe tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:13.949850 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fcf234a7-b90e-4fd6-8f2e-f1e6167d5dfe tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:13.959344 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fcf234a7-b90e-4fd6-8f2e-f1e6167d5dfe tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1574 microversion: 2.1 time: 0.213401 Jun 27 21:21:13.959936 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 327/682] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:13 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1574 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:21:14.462939 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5a3fef97-1d9d-4bd4-a0af-ed9e787c8417 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:14.463526 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-5a3fef97-1d9d-4bd4-a0af-ed9e787c8417 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:14.470123 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5a3fef97-1d9d-4bd4-a0af-ed9e787c8417 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:14.470558 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5a3fef97-1d9d-4bd4-a0af-ed9e787c8417 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:14.471416 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5a3fef97-1d9d-4bd4-a0af-ed9e787c8417 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:14.471827 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5a3fef97-1d9d-4bd4-a0af-ed9e787c8417 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:14.623517 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5a3fef97-1d9d-4bd4-a0af-ed9e787c8417 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:14.632007 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5a3fef97-1d9d-4bd4-a0af-ed9e787c8417 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:14.633754 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5a3fef97-1d9d-4bd4-a0af-ed9e787c8417 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:14.635513 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5a3fef97-1d9d-4bd4-a0af-ed9e787c8417 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1721 microversion: 2.20 time: 0.177647 Jun 27 21:21:14.636094 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 356/683] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:14 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:14.981221 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-19d3e6b8-23ae-4cf6-a5ff-f124b2688d29 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:14.981913 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-19d3e6b8-23ae-4cf6-a5ff-f124b2688d29 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:14.989314 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-19d3e6b8-23ae-4cf6-a5ff-f124b2688d29 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:14.989864 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-19d3e6b8-23ae-4cf6-a5ff-f124b2688d29 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:14.990707 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-19d3e6b8-23ae-4cf6-a5ff-f124b2688d29 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:14.991309 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-19d3e6b8-23ae-4cf6-a5ff-f124b2688d29 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:15.130174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-19d3e6b8-23ae-4cf6-a5ff-f124b2688d29 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:15.138436 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-19d3e6b8-23ae-4cf6-a5ff-f124b2688d29 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1574 microversion: 2.1 time: 0.161237 Jun 27 21:21:15.139016 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 328/684] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:14 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:15.655380 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-12245b14-1b21-4b30-ae16-ea6a2cc0a9e6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:15.656647 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-12245b14-1b21-4b30-ae16-ea6a2cc0a9e6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:15.664000 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-12245b14-1b21-4b30-ae16-ea6a2cc0a9e6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:15.664446 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-12245b14-1b21-4b30-ae16-ea6a2cc0a9e6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:15.665889 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-12245b14-1b21-4b30-ae16-ea6a2cc0a9e6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:15.666147 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-12245b14-1b21-4b30-ae16-ea6a2cc0a9e6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:15.811534 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-12245b14-1b21-4b30-ae16-ea6a2cc0a9e6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:15.819837 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-12245b14-1b21-4b30-ae16-ea6a2cc0a9e6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:15.821620 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-12245b14-1b21-4b30-ae16-ea6a2cc0a9e6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:15.822765 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-12245b14-1b21-4b30-ae16-ea6a2cc0a9e6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1721 microversion: 2.20 time: 0.172650 Jun 27 21:21:15.823339 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 357/685] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:15 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:16.156295 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2b76a80f-2e36-4767-862a-aa10bf7b5ff6 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:16.157667 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2b76a80f-2e36-4767-862a-aa10bf7b5ff6 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:16.166628 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b76a80f-2e36-4767-862a-aa10bf7b5ff6 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:16.167082 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b76a80f-2e36-4767-862a-aa10bf7b5ff6 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:16.167864 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b76a80f-2e36-4767-862a-aa10bf7b5ff6 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:16.168476 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b76a80f-2e36-4767-862a-aa10bf7b5ff6 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:16.318795 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2b76a80f-2e36-4767-862a-aa10bf7b5ff6 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:16.327970 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2b76a80f-2e36-4767-862a-aa10bf7b5ff6 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1574 microversion: 2.1 time: 0.175537 Jun 27 21:21:16.328590 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 329/686] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:16 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:16.842450 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e67a419f-22c0-4537-831f-731faf254ea4 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:16.843322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e67a419f-22c0-4537-831f-731faf254ea4 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:16.851724 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e67a419f-22c0-4537-831f-731faf254ea4 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:16.852177 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e67a419f-22c0-4537-831f-731faf254ea4 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:16.853013 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e67a419f-22c0-4537-831f-731faf254ea4 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:16.853451 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e67a419f-22c0-4537-831f-731faf254ea4 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:17.011334 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e67a419f-22c0-4537-831f-731faf254ea4 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:17.022439 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e67a419f-22c0-4537-831f-731faf254ea4 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:17.023954 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e67a419f-22c0-4537-831f-731faf254ea4 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:17.025415 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e67a419f-22c0-4537-831f-731faf254ea4 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1742 microversion: 2.20 time: 0.187596 Jun 27 21:21:17.034087 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 358/687] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:16 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1742 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:17.141518 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f60a4a69-8517-4218-a626-3e3b1413ec8b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:17.142006 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f60a4a69-8517-4218-a626-3e3b1413ec8b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:17.143983 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=60 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:17.148988 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f60a4a69-8517-4218-a626-3e3b1413ec8b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:17.149380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f60a4a69-8517-4218-a626-3e3b1413ec8b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:17.150241 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f60a4a69-8517-4218-a626-3e3b1413ec8b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:17.150670 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f60a4a69-8517-4218-a626-3e3b1413ec8b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:17.175870 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f60a4a69-8517-4218-a626-3e3b1413ec8b tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/ips" status: 200 len: 146 microversion: 2.1 time: 0.233659 Jun 27 21:21:17.176776 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 330/688] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 27 21:21:16 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/ips => generated 146 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:21:17.349476 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-23f6d757-8d2c-4fc5-9500-6dfe5b1b0627 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:17.350512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-23f6d757-8d2c-4fc5-9500-6dfe5b1b0627 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:17.358807 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-23f6d757-8d2c-4fc5-9500-6dfe5b1b0627 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:17.359247 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-23f6d757-8d2c-4fc5-9500-6dfe5b1b0627 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:17.360072 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-23f6d757-8d2c-4fc5-9500-6dfe5b1b0627 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:17.360568 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-23f6d757-8d2c-4fc5-9500-6dfe5b1b0627 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:17.548124 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-23f6d757-8d2c-4fc5-9500-6dfe5b1b0627 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:17.557076 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-23f6d757-8d2c-4fc5-9500-6dfe5b1b0627 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1574 microversion: 2.1 time: 0.214870 Jun 27 21:21:17.557673 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 359/689] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:17 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1574 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:18.044834 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e3289f73-53d3-445b-8fff-591f72304d75 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:18.045458 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e3289f73-53d3-445b-8fff-591f72304d75 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:18.052336 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3289f73-53d3-445b-8fff-591f72304d75 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:18.052798 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3289f73-53d3-445b-8fff-591f72304d75 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:18.053633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3289f73-53d3-445b-8fff-591f72304d75 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:18.054045 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3289f73-53d3-445b-8fff-591f72304d75 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:18.206080 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e3289f73-53d3-445b-8fff-591f72304d75 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:18.215389 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e3289f73-53d3-445b-8fff-591f72304d75 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:18.216896 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e3289f73-53d3-445b-8fff-591f72304d75 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:18.218082 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e3289f73-53d3-445b-8fff-591f72304d75 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1742 microversion: 2.20 time: 0.177286 Jun 27 21:21:18.218638 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 331/690] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:18 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1742 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:18.575841 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1328d55c-4a5b-4c84-b1c6-df832bd4b33e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:18.576644 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1328d55c-4a5b-4c84-b1c6-df832bd4b33e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:18.584420 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1328d55c-4a5b-4c84-b1c6-df832bd4b33e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:18.584858 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1328d55c-4a5b-4c84-b1c6-df832bd4b33e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:18.585791 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1328d55c-4a5b-4c84-b1c6-df832bd4b33e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:18.586313 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1328d55c-4a5b-4c84-b1c6-df832bd4b33e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:18.589463 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:18.757103 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1328d55c-4a5b-4c84-b1c6-df832bd4b33e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:18.766238 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1328d55c-4a5b-4c84-b1c6-df832bd4b33e tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1574 microversion: 2.1 time: 0.195723 Jun 27 21:21:18.766904 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 360/691] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:18 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1574 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:19.353303 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-694b91c1-18bc-4c62-baef-322916acc9f9 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:19.353917 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-694b91c1-18bc-4c62-baef-322916acc9f9 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:19.363750 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-694b91c1-18bc-4c62-baef-322916acc9f9 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:19.364195 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-694b91c1-18bc-4c62-baef-322916acc9f9 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:19.364994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-694b91c1-18bc-4c62-baef-322916acc9f9 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:19.365428 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-694b91c1-18bc-4c62-baef-322916acc9f9 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:19.511430 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-694b91c1-18bc-4c62-baef-322916acc9f9 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:19.519443 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-694b91c1-18bc-4c62-baef-322916acc9f9 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:19.520948 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-694b91c1-18bc-4c62-baef-322916acc9f9 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:19.522135 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-694b91c1-18bc-4c62-baef-322916acc9f9 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1742 microversion: 2.20 time: 0.288441 Jun 27 21:21:19.522704 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 332/692] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:19 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1742 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:19.785188 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-52f5b3d4-bb7e-4176-9994-d8b30533ea53 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:19.786063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-52f5b3d4-bb7e-4176-9994-d8b30533ea53 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:19.793543 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-52f5b3d4-bb7e-4176-9994-d8b30533ea53 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:19.794155 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-52f5b3d4-bb7e-4176-9994-d8b30533ea53 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:19.795395 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-52f5b3d4-bb7e-4176-9994-d8b30533ea53 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:19.795600 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-52f5b3d4-bb7e-4176-9994-d8b30533ea53 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:19.979826 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-52f5b3d4-bb7e-4176-9994-d8b30533ea53 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:19.994587 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-52f5b3d4-bb7e-4176-9994-d8b30533ea53 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1574 microversion: 2.1 time: 0.213985 Jun 27 21:21:19.995637 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 361/693] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:19 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1574 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:20.541369 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-747cf375-43d2-48c9-be93-927ccc562443 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:20.542123 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-747cf375-43d2-48c9-be93-927ccc562443 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:20.548859 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-747cf375-43d2-48c9-be93-927ccc562443 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:20.549323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-747cf375-43d2-48c9-be93-927ccc562443 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:20.550148 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-747cf375-43d2-48c9-be93-927ccc562443 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:20.550496 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-747cf375-43d2-48c9-be93-927ccc562443 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:20.569747 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:20.676485 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b98a7b4b-4736-45b4-9968-6c50767c22d5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d18b4a5-9f9e-4406-93e6-5dbe34c7156b"}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:20.677621 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b98a7b4b-4736-45b4-9968-6c50767c22d5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:20.684053 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b98a7b4b-4736-45b4-9968-6c50767c22d5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:20.684753 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b98a7b4b-4736-45b4-9968-6c50767c22d5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:20.685735 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b98a7b4b-4736-45b4-9968-6c50767c22d5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:20.686311 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b98a7b4b-4736-45b4-9968-6c50767c22d5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:20.719537 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-747cf375-43d2-48c9-be93-927ccc562443 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:20.731253 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-747cf375-43d2-48c9-be93-927ccc562443 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:20.733091 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-747cf375-43d2-48c9-be93-927ccc562443 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:20.735721 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-747cf375-43d2-48c9-be93-927ccc562443 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1742 microversion: 2.20 time: 0.198427 Jun 27 21:21:20.736563 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 333/694] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:20 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1742 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:21.016436 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b98a7b4b-4736-45b4-9968-6c50767c22d5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "POST /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343197 Jun 27 21:21:21.019556 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-19830849-f3e3-4184-9f24-29e35415b86f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:21.019556 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-19830849-f3e3-4184-9f24-29e35415b86f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:21.026784 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 362/695] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 27 21:21:20 2022] POST /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-volume_attachments => generated 194 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:21.027536 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-19830849-f3e3-4184-9f24-29e35415b86f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:21.027992 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-19830849-f3e3-4184-9f24-29e35415b86f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:21.028780 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-19830849-f3e3-4184-9f24-29e35415b86f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:21.029299 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-19830849-f3e3-4184-9f24-29e35415b86f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:21.227818 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-19830849-f3e3-4184-9f24-29e35415b86f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:21.236285 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-19830849-f3e3-4184-9f24-29e35415b86f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1574 microversion: 2.1 time: 0.221701 Jun 27 21:21:21.237269 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 334/696] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:21 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1574 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:21:21.781647 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-bcfbb946-6592-4690-b2c1-98997d5ad4e5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:21.784739 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-bcfbb946-6592-4690-b2c1-98997d5ad4e5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:21.808335 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bcfbb946-6592-4690-b2c1-98997d5ad4e5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:21.822107 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bcfbb946-6592-4690-b2c1-98997d5ad4e5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:21.824147 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bcfbb946-6592-4690-b2c1-98997d5ad4e5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:21.826763 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bcfbb946-6592-4690-b2c1-98997d5ad4e5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:21.982459 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-a8baee92-93c6-4d12-9ab8-bbeba7a09940 req-d7f55555-9723-4806-a549-c500a1dd50b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a775668d-41e5-407f-ad33-a3b265985d10", "name": "network-vif-plugged", "status": "completed", "tag": "b19d4fbb-0cf8-4c5b-b7e2-ad5cd60e8812"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:22.009930 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a8baee92-93c6-4d12-9ab8-bbeba7a09940 req-d7f55555-9723-4806-a549-c500a1dd50b6 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:22.010649 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a8baee92-93c6-4d12-9ab8-bbeba7a09940 req-d7f55555-9723-4806-a549-c500a1dd50b6 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:22.031881 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-a8baee92-93c6-4d12-9ab8-bbeba7a09940 req-d7f55555-9723-4806-a549-c500a1dd50b6 service nova] Creating event network-vif-plugged:b19d4fbb-0cf8-4c5b-b7e2-ad5cd60e8812 for instance a775668d-41e5-407f-ad33-a3b265985d10 on hv-cinder-84773 Jun 27 21:21:22.040832 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-a8baee92-93c6-4d12-9ab8-bbeba7a09940 req-d7f55555-9723-4806-a549-c500a1dd50b6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066105 Jun 27 21:21:22.042190 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 335/697] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:22.195805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-bcfbb946-6592-4690-b2c1-98997d5ad4e5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:22.212950 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-bcfbb946-6592-4690-b2c1-98997d5ad4e5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:22.215045 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-bcfbb946-6592-4690-b2c1-98997d5ad4e5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:22.216541 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-bcfbb946-6592-4690-b2c1-98997d5ad4e5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1737 microversion: 2.20 time: 0.464600 Jun 27 21:21:22.217712 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 363/698] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:21 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1737 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:22.255258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3aa3bce1-8f27-4ff1-bb87-7161bbf19a7d tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:22.255944 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3aa3bce1-8f27-4ff1-bb87-7161bbf19a7d tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:22.268681 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3aa3bce1-8f27-4ff1-bb87-7161bbf19a7d tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:22.269667 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3aa3bce1-8f27-4ff1-bb87-7161bbf19a7d tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:22.271323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3aa3bce1-8f27-4ff1-bb87-7161bbf19a7d tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:22.271760 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3aa3bce1-8f27-4ff1-bb87-7161bbf19a7d tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:22.456646 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3aa3bce1-8f27-4ff1-bb87-7161bbf19a7d tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:22.479714 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3aa3bce1-8f27-4ff1-bb87-7161bbf19a7d tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1574 microversion: 2.1 time: 0.228563 Jun 27 21:21:22.493205 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 336/699] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:22 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1574 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:23.250659 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7f181648-043e-4d71-a1af-8656a4e835ff tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:23.251272 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7f181648-043e-4d71-a1af-8656a4e835ff tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:23.266896 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7f181648-043e-4d71-a1af-8656a4e835ff tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:23.267348 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7f181648-043e-4d71-a1af-8656a4e835ff tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:23.268244 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7f181648-043e-4d71-a1af-8656a4e835ff tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:23.269114 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7f181648-043e-4d71-a1af-8656a4e835ff tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:23.469615 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7f181648-043e-4d71-a1af-8656a4e835ff tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:23.479599 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7f181648-043e-4d71-a1af-8656a4e835ff tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:23.481229 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7f181648-043e-4d71-a1af-8656a4e835ff tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:23.482449 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7f181648-043e-4d71-a1af-8656a4e835ff tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1737 microversion: 2.20 time: 0.237238 Jun 27 21:21:23.483043 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 364/700] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:23 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1737 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:23.499738 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-33959673-e376-45e0-bd6b-a4f871d23ad7 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:23.500986 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-33959673-e376-45e0-bd6b-a4f871d23ad7 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:23.508169 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33959673-e376-45e0-bd6b-a4f871d23ad7 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:23.509422 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33959673-e376-45e0-bd6b-a4f871d23ad7 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:23.510556 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33959673-e376-45e0-bd6b-a4f871d23ad7 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:23.511208 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33959673-e376-45e0-bd6b-a4f871d23ad7 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:23.730589 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-33959673-e376-45e0-bd6b-a4f871d23ad7 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:23.747827 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-33959673-e376-45e0-bd6b-a4f871d23ad7 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1574 microversion: 2.1 time: 0.251858 Jun 27 21:21:23.758059 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 337/701] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:23 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1574 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:24.505362 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-cbd1b53e-a624-4578-bea1-546968dd8d85 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:24.506820 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-cbd1b53e-a624-4578-bea1-546968dd8d85 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:24.514844 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cbd1b53e-a624-4578-bea1-546968dd8d85 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:24.515286 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cbd1b53e-a624-4578-bea1-546968dd8d85 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:24.516300 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cbd1b53e-a624-4578-bea1-546968dd8d85 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:24.516758 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cbd1b53e-a624-4578-bea1-546968dd8d85 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:24.766139 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-12536053-0b9a-4eac-898d-d1496501482c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:24.767386 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-12536053-0b9a-4eac-898d-d1496501482c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:24.777698 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-12536053-0b9a-4eac-898d-d1496501482c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:24.778899 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-12536053-0b9a-4eac-898d-d1496501482c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:24.780568 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-12536053-0b9a-4eac-898d-d1496501482c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:24.782013 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-12536053-0b9a-4eac-898d-d1496501482c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:24.882942 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-cbd1b53e-a624-4578-bea1-546968dd8d85 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:24.896357 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-cbd1b53e-a624-4578-bea1-546968dd8d85 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:24.906235 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-cbd1b53e-a624-4578-bea1-546968dd8d85 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:24.907811 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-cbd1b53e-a624-4578-bea1-546968dd8d85 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1737 microversion: 2.20 time: 0.410191 Jun 27 21:21:24.911380 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 365/702] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:24 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1737 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:25.059497 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-12536053-0b9a-4eac-898d-d1496501482c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:25.074530 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-12536053-0b9a-4eac-898d-d1496501482c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1574 microversion: 2.1 time: 0.310020 Jun 27 21:21:25.075819 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 338/703] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:24 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1574 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:21:25.860763 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-740c163c-fa35-4d6d-a817-749bd7e93094 req-a95af616-05ef-4029-aefd-99d3f6cb1720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9323a6ac-3a15-471a-b676-eb3e809a8637", "name": "network-vif-plugged", "status": "completed", "tag": "36112ae1-bee5-4df6-9469-82c6af7bb1f4"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:25.872463 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-740c163c-fa35-4d6d-a817-749bd7e93094 req-a95af616-05ef-4029-aefd-99d3f6cb1720 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:25.873314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-740c163c-fa35-4d6d-a817-749bd7e93094 req-a95af616-05ef-4029-aefd-99d3f6cb1720 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:25.893524 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-740c163c-fa35-4d6d-a817-749bd7e93094 req-a95af616-05ef-4029-aefd-99d3f6cb1720 service nova] Creating event network-vif-plugged:36112ae1-bee5-4df6-9469-82c6af7bb1f4 for instance 9323a6ac-3a15-471a-b676-eb3e809a8637 on hv-cinder-84773 Jun 27 21:21:25.900648 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-740c163c-fa35-4d6d-a817-749bd7e93094 req-a95af616-05ef-4029-aefd-99d3f6cb1720 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061399 Jun 27 21:21:25.902519 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 366/704] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:25.935165 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-248277e1-60d1-4aec-a3a2-0dd5a22c2310 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:25.935839 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-248277e1-60d1-4aec-a3a2-0dd5a22c2310 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:25.959576 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-248277e1-60d1-4aec-a3a2-0dd5a22c2310 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:25.960861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-248277e1-60d1-4aec-a3a2-0dd5a22c2310 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:25.961217 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-248277e1-60d1-4aec-a3a2-0dd5a22c2310 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:25.964661 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-248277e1-60d1-4aec-a3a2-0dd5a22c2310 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:26.093742 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-098b208c-8d9a-4794-8d69-53353500fd11 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:26.094457 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-098b208c-8d9a-4794-8d69-53353500fd11 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:26.112876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-098b208c-8d9a-4794-8d69-53353500fd11 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:26.113566 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-098b208c-8d9a-4794-8d69-53353500fd11 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:26.114539 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-098b208c-8d9a-4794-8d69-53353500fd11 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:26.115207 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-098b208c-8d9a-4794-8d69-53353500fd11 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:26.187332 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-248277e1-60d1-4aec-a3a2-0dd5a22c2310 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:26.198105 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-248277e1-60d1-4aec-a3a2-0dd5a22c2310 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:26.200226 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-248277e1-60d1-4aec-a3a2-0dd5a22c2310 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:26.201984 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-248277e1-60d1-4aec-a3a2-0dd5a22c2310 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1737 microversion: 2.20 time: 0.270976 Jun 27 21:21:26.215683 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 339/705] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:25 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1737 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:26.416536 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-098b208c-8d9a-4794-8d69-53353500fd11 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:26.435086 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-098b208c-8d9a-4794-8d69-53353500fd11 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1574 microversion: 2.1 time: 0.344663 Jun 27 21:21:26.454906 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 367/706] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:26 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1574 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:27.232447 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-28564c0e-6492-41fe-8325-23e740e6aa51 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:27.236288 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-28564c0e-6492-41fe-8325-23e740e6aa51 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:27.252677 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-28564c0e-6492-41fe-8325-23e740e6aa51 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:27.253177 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-28564c0e-6492-41fe-8325-23e740e6aa51 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:27.253944 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-28564c0e-6492-41fe-8325-23e740e6aa51 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:27.254377 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-28564c0e-6492-41fe-8325-23e740e6aa51 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:27.461235 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-956c39f6-7cf0-4004-b7a7-b2733b0af7ce tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:27.462681 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-956c39f6-7cf0-4004-b7a7-b2733b0af7ce tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:27.476665 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-956c39f6-7cf0-4004-b7a7-b2733b0af7ce tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:27.477238 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-956c39f6-7cf0-4004-b7a7-b2733b0af7ce tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:27.478442 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-956c39f6-7cf0-4004-b7a7-b2733b0af7ce tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:27.478932 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-956c39f6-7cf0-4004-b7a7-b2733b0af7ce tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:27.527208 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-28564c0e-6492-41fe-8325-23e740e6aa51 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:27.544123 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-28564c0e-6492-41fe-8325-23e740e6aa51 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:27.546006 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-28564c0e-6492-41fe-8325-23e740e6aa51 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:27.547446 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-28564c0e-6492-41fe-8325-23e740e6aa51 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1737 microversion: 2.20 time: 0.327921 Jun 27 21:21:27.548506 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 340/707] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:27 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1737 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:27.721675 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-956c39f6-7cf0-4004-b7a7-b2733b0af7ce tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:27.730142 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-956c39f6-7cf0-4004-b7a7-b2733b0af7ce tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1574 microversion: 2.1 time: 0.273463 Jun 27 21:21:27.731675 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 368/708] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:27 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1574 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:28.567235 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8f8d0d42-29ae-4432-b708-35f9623aa989 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:28.567840 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8f8d0d42-29ae-4432-b708-35f9623aa989 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:28.578783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f8d0d42-29ae-4432-b708-35f9623aa989 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:28.581693 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f8d0d42-29ae-4432-b708-35f9623aa989 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:28.589761 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f8d0d42-29ae-4432-b708-35f9623aa989 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:28.590534 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f8d0d42-29ae-4432-b708-35f9623aa989 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:28.766461 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-744208a1-42fc-4312-bddd-59fb964ba75c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:28.767273 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-744208a1-42fc-4312-bddd-59fb964ba75c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:28.786145 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-744208a1-42fc-4312-bddd-59fb964ba75c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:28.792115 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-744208a1-42fc-4312-bddd-59fb964ba75c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:28.793379 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-744208a1-42fc-4312-bddd-59fb964ba75c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:28.794678 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-744208a1-42fc-4312-bddd-59fb964ba75c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:28.996534 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8f8d0d42-29ae-4432-b708-35f9623aa989 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:29.031991 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8f8d0d42-29ae-4432-b708-35f9623aa989 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:29.033777 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8f8d0d42-29ae-4432-b708-35f9623aa989 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:29.035882 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8f8d0d42-29ae-4432-b708-35f9623aa989 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1737 microversion: 2.20 time: 0.472716 Jun 27 21:21:29.037188 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 341/709] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:28 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1737 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:21:29.042503 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-218f97f1-7aae-4a62-a5fc-dde7078c6f67 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:29.043869 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-218f97f1-7aae-4a62-a5fc-dde7078c6f67 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:29.051121 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-218f97f1-7aae-4a62-a5fc-dde7078c6f67 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:29.051831 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-218f97f1-7aae-4a62-a5fc-dde7078c6f67 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:29.052749 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-218f97f1-7aae-4a62-a5fc-dde7078c6f67 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:29.053375 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-218f97f1-7aae-4a62-a5fc-dde7078c6f67 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:29.091102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-218f97f1-7aae-4a62-a5fc-dde7078c6f67 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052240 Jun 27 21:21:29.097460 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 342/710] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 27 21:21:29 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:29.102490 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5af5229f-251e-48c2-86b6-b66401270abc tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:29.103220 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5af5229f-251e-48c2-86b6-b66401270abc tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:29.107753 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-744208a1-42fc-4312-bddd-59fb964ba75c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:29.110424 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5af5229f-251e-48c2-86b6-b66401270abc tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:29.111064 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5af5229f-251e-48c2-86b6-b66401270abc tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:29.112048 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5af5229f-251e-48c2-86b6-b66401270abc tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:29.112622 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5af5229f-251e-48c2-86b6-b66401270abc tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:29.116049 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-744208a1-42fc-4312-bddd-59fb964ba75c tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1561 microversion: 2.1 time: 0.361233 Jun 27 21:21:29.117712 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 369/711] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:28 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1561 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:29.164229 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5af5229f-251e-48c2-86b6-b66401270abc tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-volume_attachments/9d18b4a5-9f9e-4406-93e6-5dbe34c7156b" status: 200 len: 194 microversion: 2.1 time: 0.065657 Jun 27 21:21:29.166812 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 343/712] 10.222.0.13 () {58 vars in 1412 bytes} [Mon Jun 27 21:21:29 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-volume_attachments/9d18b4a5-9f9e-4406-93e6-5dbe34c7156b => generated 194 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:30.070560 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-857e543a-a364-4ccf-aa38-d2f0e3b77d8e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:30.072060 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-857e543a-a364-4ccf-aa38-d2f0e3b77d8e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:30.083810 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=76 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:30.086625 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-857e543a-a364-4ccf-aa38-d2f0e3b77d8e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:30.087366 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-857e543a-a364-4ccf-aa38-d2f0e3b77d8e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:30.088371 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-857e543a-a364-4ccf-aa38-d2f0e3b77d8e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:30.088991 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-857e543a-a364-4ccf-aa38-d2f0e3b77d8e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:30.366258 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-857e543a-a364-4ccf-aa38-d2f0e3b77d8e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:30.390081 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-857e543a-a364-4ccf-aa38-d2f0e3b77d8e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:30.392619 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-857e543a-a364-4ccf-aa38-d2f0e3b77d8e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:30.394147 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-857e543a-a364-4ccf-aa38-d2f0e3b77d8e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1737 microversion: 2.20 time: 0.327405 Jun 27 21:21:30.395303 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 370/713] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:30 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1737 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:30.689170 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c504ad7a-7c77-4741-9dc4-5b0a89ae783c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cece49b6-3737-4175-b560-1791b3339fa7"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:30.692146 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c504ad7a-7c77-4741-9dc4-5b0a89ae783c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:30.706619 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c504ad7a-7c77-4741-9dc4-5b0a89ae783c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:30.708014 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c504ad7a-7c77-4741-9dc4-5b0a89ae783c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:30.709635 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c504ad7a-7c77-4741-9dc4-5b0a89ae783c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:30.710337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c504ad7a-7c77-4741-9dc4-5b0a89ae783c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:31.163139 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c504ad7a-7c77-4741-9dc4-5b0a89ae783c tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "POST /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.482918 Jun 27 21:21:31.166633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 344/714] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 27 21:21:30 2022] POST /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-volume_attachments => generated 194 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:31.416169 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-aa737d14-5804-40eb-8221-72bdf336c98f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:31.417001 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-aa737d14-5804-40eb-8221-72bdf336c98f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:31.435969 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-aa737d14-5804-40eb-8221-72bdf336c98f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:31.436787 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-aa737d14-5804-40eb-8221-72bdf336c98f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:31.438179 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-aa737d14-5804-40eb-8221-72bdf336c98f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:31.438955 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-aa737d14-5804-40eb-8221-72bdf336c98f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:31.626783 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-aa737d14-5804-40eb-8221-72bdf336c98f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:31.636370 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-aa737d14-5804-40eb-8221-72bdf336c98f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:31.639047 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-aa737d14-5804-40eb-8221-72bdf336c98f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:31.641375 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-aa737d14-5804-40eb-8221-72bdf336c98f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1737 microversion: 2.20 time: 0.230458 Jun 27 21:21:31.673780 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 371/715] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:31 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1737 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:32.690072 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3f4fce74-f566-44ed-b0e2-a8ec8b956e55 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:32.691634 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3f4fce74-f566-44ed-b0e2-a8ec8b956e55 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:32.698836 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3f4fce74-f566-44ed-b0e2-a8ec8b956e55 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:32.699287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3f4fce74-f566-44ed-b0e2-a8ec8b956e55 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:32.700119 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3f4fce74-f566-44ed-b0e2-a8ec8b956e55 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:32.700553 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3f4fce74-f566-44ed-b0e2-a8ec8b956e55 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:32.856428 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3f4fce74-f566-44ed-b0e2-a8ec8b956e55 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:32.865030 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3f4fce74-f566-44ed-b0e2-a8ec8b956e55 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:32.866533 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3f4fce74-f566-44ed-b0e2-a8ec8b956e55 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:32.867848 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3f4fce74-f566-44ed-b0e2-a8ec8b956e55 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1737 microversion: 2.20 time: 0.183877 Jun 27 21:21:32.868458 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 345/716] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:32 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:33.887034 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-62a70b22-ffd2-41df-8b54-3962cebc2fbd tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:33.887658 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-62a70b22-ffd2-41df-8b54-3962cebc2fbd tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:33.894190 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-62a70b22-ffd2-41df-8b54-3962cebc2fbd tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:33.894565 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-62a70b22-ffd2-41df-8b54-3962cebc2fbd tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:33.895331 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-62a70b22-ffd2-41df-8b54-3962cebc2fbd tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:33.895762 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-62a70b22-ffd2-41df-8b54-3962cebc2fbd tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:34.047561 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-62a70b22-ffd2-41df-8b54-3962cebc2fbd tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:34.060151 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-62a70b22-ffd2-41df-8b54-3962cebc2fbd tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:34.061486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-62a70b22-ffd2-41df-8b54-3962cebc2fbd tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:34.062674 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-62a70b22-ffd2-41df-8b54-3962cebc2fbd tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1719 microversion: 2.20 time: 0.180014 Jun 27 21:21:34.063245 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 372/717] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:33 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1719 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:35.083850 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cb131233-d4c7-4550-97a5-45de277c3862 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:35.084444 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cb131233-d4c7-4550-97a5-45de277c3862 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:35.091448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb131233-d4c7-4550-97a5-45de277c3862 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:35.091898 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb131233-d4c7-4550-97a5-45de277c3862 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:35.093070 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb131233-d4c7-4550-97a5-45de277c3862 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:35.093188 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb131233-d4c7-4550-97a5-45de277c3862 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:35.241378 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cb131233-d4c7-4550-97a5-45de277c3862 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:35.250231 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cb131233-d4c7-4550-97a5-45de277c3862 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:35.251710 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cb131233-d4c7-4550-97a5-45de277c3862 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:35.252868 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cb131233-d4c7-4550-97a5-45de277c3862 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1719 microversion: 2.20 time: 0.173448 Jun 27 21:21:35.253799 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 346/718] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:35 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:36.271324 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7ed67fe4-c3e3-458b-8c60-9c95dc5334a3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:36.271907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7ed67fe4-c3e3-458b-8c60-9c95dc5334a3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:36.279021 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7ed67fe4-c3e3-458b-8c60-9c95dc5334a3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:36.279456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7ed67fe4-c3e3-458b-8c60-9c95dc5334a3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:36.280216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7ed67fe4-c3e3-458b-8c60-9c95dc5334a3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:36.280624 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7ed67fe4-c3e3-458b-8c60-9c95dc5334a3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:36.421527 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7ed67fe4-c3e3-458b-8c60-9c95dc5334a3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:36.429904 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7ed67fe4-c3e3-458b-8c60-9c95dc5334a3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:36.431476 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7ed67fe4-c3e3-458b-8c60-9c95dc5334a3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:36.432660 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7ed67fe4-c3e3-458b-8c60-9c95dc5334a3 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1662 microversion: 2.20 time: 0.165275 Jun 27 21:21:36.433277 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 373/719] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:36 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1662 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:36.450993 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7b94795b-3f11-449e-85a7-8d6a1e18efcb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db9ff48a-18b6-499a-a3fb-bdb3253079d5"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:36.452168 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7b94795b-3f11-449e-85a7-8d6a1e18efcb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:36.459467 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b94795b-3f11-449e-85a7-8d6a1e18efcb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:36.459929 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b94795b-3f11-449e-85a7-8d6a1e18efcb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:36.460726 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b94795b-3f11-449e-85a7-8d6a1e18efcb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:36.461192 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b94795b-3f11-449e-85a7-8d6a1e18efcb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:36.882620 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:36.991358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7b94795b-3f11-449e-85a7-8d6a1e18efcb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "POST /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.544181 Jun 27 21:21:36.992707 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 347/720] 10.222.0.13 () {62 vars in 1363 bytes} [Mon Jun 27 21:21:36 2022] POST /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10/os-volume_attachments => generated 188 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:21:37.140463 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-995790a2-424a-46b1-9c71-a40f18dbf805 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:37.140987 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-995790a2-424a-46b1-9c71-a40f18dbf805 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:37.147402 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-995790a2-424a-46b1-9c71-a40f18dbf805 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:37.147806 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-995790a2-424a-46b1-9c71-a40f18dbf805 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:37.148568 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-995790a2-424a-46b1-9c71-a40f18dbf805 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:37.149099 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-995790a2-424a-46b1-9c71-a40f18dbf805 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:37.259538 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:37.428992 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-995790a2-424a-46b1-9c71-a40f18dbf805 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10/os-volume_attachments/db9ff48a-18b6-499a-a3fb-bdb3253079d5" status: 202 len: 0 microversion: 2.20 time: 0.292442 Jun 27 21:21:37.433623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 374/721] 10.222.0.13 () {60 vars in 1456 bytes} [Mon Jun 27 21:21:37 2022] DELETE /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10/os-volume_attachments/db9ff48a-18b6-499a-a3fb-bdb3253079d5 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:21:37.493351 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-55329e7b-4ca2-4ab8-beb5-9cfae8eac709 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:37.493937 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-55329e7b-4ca2-4ab8-beb5-9cfae8eac709 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:37.504800 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-55329e7b-4ca2-4ab8-beb5-9cfae8eac709 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:37.505305 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-55329e7b-4ca2-4ab8-beb5-9cfae8eac709 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:37.506283 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-55329e7b-4ca2-4ab8-beb5-9cfae8eac709 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:37.506873 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-55329e7b-4ca2-4ab8-beb5-9cfae8eac709 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:37.725410 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-55329e7b-4ca2-4ab8-beb5-9cfae8eac709 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "POST /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10/action" status: 202 len: 0 microversion: 2.20 time: 0.236205 Jun 27 21:21:37.729434 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 348/722] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jun 27 21:21:37 2022] POST /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:21:37.737296 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-49babc75-ea88-443f-9531-c2517a4a4fb6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:37.737957 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-49babc75-ea88-443f-9531-c2517a4a4fb6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:37.746557 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-49babc75-ea88-443f-9531-c2517a4a4fb6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:37.748230 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-49babc75-ea88-443f-9531-c2517a4a4fb6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:37.749042 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-693da945-7569-4721-b3f3-5c31d2f11e04 req-0d821f1b-9cd9-4963-b948-d644b6565d18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a775668d-41e5-407f-ad33-a3b265985d10", "name": "network-vif-unplugged", "status": "completed", "tag": "b19d4fbb-0cf8-4c5b-b7e2-ad5cd60e8812"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:37.750698 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-49babc75-ea88-443f-9531-c2517a4a4fb6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:37.751225 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-49babc75-ea88-443f-9531-c2517a4a4fb6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:37.763322 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-693da945-7569-4721-b3f3-5c31d2f11e04 req-0d821f1b-9cd9-4963-b948-d644b6565d18 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:37.763762 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-693da945-7569-4721-b3f3-5c31d2f11e04 req-0d821f1b-9cd9-4963-b948-d644b6565d18 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:37.778698 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.compute.server_external_events [req-693da945-7569-4721-b3f3-5c31d2f11e04 req-0d821f1b-9cd9-4963-b948-d644b6565d18 service nova] Unable to find a host for instance a775668d-41e5-407f-ad33-a3b265985d10. Dropping event network-vif-unplugged {{(pid=117889) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 27 21:21:37.780394 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-693da945-7569-4721-b3f3-5c31d2f11e04 req-0d821f1b-9cd9-4963-b948-d644b6565d18 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038403 Jun 27 21:21:37.781396 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 349/723] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 27 21:21:37.940702 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-49babc75-ea88-443f-9531-c2517a4a4fb6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:37.950332 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-49babc75-ea88-443f-9531-c2517a4a4fb6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:37.951813 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-49babc75-ea88-443f-9531-c2517a4a4fb6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:37.953181 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-49babc75-ea88-443f-9531-c2517a4a4fb6 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1670 microversion: 2.20 time: 0.221329 Jun 27 21:21:37.953778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 375/724] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:37 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1670 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:38.978652 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6b15c1b4-eb41-4c83-bd79-65be397cbb54 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:38.979593 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6b15c1b4-eb41-4c83-bd79-65be397cbb54 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:38.982809 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5a5bdcc0-50fc-4f60-a7ac-6892e301f14b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:38.983529 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-5a5bdcc0-50fc-4f60-a7ac-6892e301f14b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:38.989083 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6b15c1b4-eb41-4c83-bd79-65be397cbb54 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:38.989543 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6b15c1b4-eb41-4c83-bd79-65be397cbb54 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:38.990273 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5a5bdcc0-50fc-4f60-a7ac-6892e301f14b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:38.990399 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6b15c1b4-eb41-4c83-bd79-65be397cbb54 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:38.990750 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6b15c1b4-eb41-4c83-bd79-65be397cbb54 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:38.990855 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5a5bdcc0-50fc-4f60-a7ac-6892e301f14b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:38.991650 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5a5bdcc0-50fc-4f60-a7ac-6892e301f14b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:38.992304 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5a5bdcc0-50fc-4f60-a7ac-6892e301f14b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:39.028170 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6b15c1b4-eb41-4c83-bd79-65be397cbb54 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051892 Jun 27 21:21:39.028170 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 350/725] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 27 21:21:38 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:21:39.130828 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5a5bdcc0-50fc-4f60-a7ac-6892e301f14b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:39.139228 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5a5bdcc0-50fc-4f60-a7ac-6892e301f14b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:39.140706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5a5bdcc0-50fc-4f60-a7ac-6892e301f14b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:39.141986 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5a5bdcc0-50fc-4f60-a7ac-6892e301f14b tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1728 microversion: 2.20 time: 0.163416 Jun 27 21:21:39.142557 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 376/726] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:38 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:39.170425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-eaf6fdaa-9c2f-40d7-b910-28137e4534d8 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:39.170918 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-eaf6fdaa-9c2f-40d7-b910-28137e4534d8 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:39.177474 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eaf6fdaa-9c2f-40d7-b910-28137e4534d8 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:39.177908 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eaf6fdaa-9c2f-40d7-b910-28137e4534d8 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:39.178669 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eaf6fdaa-9c2f-40d7-b910-28137e4534d8 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:39.179057 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eaf6fdaa-9c2f-40d7-b910-28137e4534d8 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:39.214372 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-eaf6fdaa-9c2f-40d7-b910-28137e4534d8 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-volume_attachments/9d18b4a5-9f9e-4406-93e6-5dbe34c7156b" status: 200 len: 194 microversion: 2.1 time: 0.048003 Jun 27 21:21:39.215001 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 351/727] 10.222.0.13 () {58 vars in 1412 bytes} [Mon Jun 27 21:21:39 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-volume_attachments/9d18b4a5-9f9e-4406-93e6-5dbe34c7156b => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:21:39.225003 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6cf672ca-c439-4087-bfa2-cb79c9b99bc5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:39.225488 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6cf672ca-c439-4087-bfa2-cb79c9b99bc5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:39.233685 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6cf672ca-c439-4087-bfa2-cb79c9b99bc5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:39.234126 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6cf672ca-c439-4087-bfa2-cb79c9b99bc5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:39.234889 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6cf672ca-c439-4087-bfa2-cb79c9b99bc5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:39.235318 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6cf672ca-c439-4087-bfa2-cb79c9b99bc5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:39.323339 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-6cf672ca-c439-4087-bfa2-cb79c9b99bc5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lazy-loading 'services' on Instance uuid 624274f6-859f-4e03-9c00-90574d06b2c5 {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:21:39.415806 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6cf672ca-c439-4087-bfa2-cb79c9b99bc5 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "DELETE /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-volume_attachments/9d18b4a5-9f9e-4406-93e6-5dbe34c7156b" status: 202 len: 0 microversion: 2.1 time: 0.194352 Jun 27 21:21:39.416483 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 377/728] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 27 21:21:39 2022] DELETE /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-volume_attachments/9d18b4a5-9f9e-4406-93e6-5dbe34c7156b => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:21:40.161918 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-44936a73-ccce-4350-9e40-6f0a4c08fb0c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:40.162680 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-44936a73-ccce-4350-9e40-6f0a4c08fb0c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:40.170050 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44936a73-ccce-4350-9e40-6f0a4c08fb0c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:40.170604 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44936a73-ccce-4350-9e40-6f0a4c08fb0c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:40.171456 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44936a73-ccce-4350-9e40-6f0a4c08fb0c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:40.171955 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44936a73-ccce-4350-9e40-6f0a4c08fb0c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:40.308438 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-44936a73-ccce-4350-9e40-6f0a4c08fb0c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:40.318323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-44936a73-ccce-4350-9e40-6f0a4c08fb0c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:40.319854 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-44936a73-ccce-4350-9e40-6f0a4c08fb0c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:40.321134 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-44936a73-ccce-4350-9e40-6f0a4c08fb0c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1728 microversion: 2.20 time: 0.163643 Jun 27 21:21:40.321689 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 352/729] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:40 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:41.345499 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8772b607-118e-40c4-9390-e28e530675eb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:41.346121 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-8772b607-118e-40c4-9390-e28e530675eb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:41.363761 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8772b607-118e-40c4-9390-e28e530675eb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:41.364970 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8772b607-118e-40c4-9390-e28e530675eb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:41.366276 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8772b607-118e-40c4-9390-e28e530675eb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:41.366980 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8772b607-118e-40c4-9390-e28e530675eb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:41.574806 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8772b607-118e-40c4-9390-e28e530675eb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:41.588497 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8772b607-118e-40c4-9390-e28e530675eb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:41.590127 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8772b607-118e-40c4-9390-e28e530675eb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:41.591350 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8772b607-118e-40c4-9390-e28e530675eb tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1728 microversion: 2.20 time: 0.255894 Jun 27 21:21:41.596734 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 378/730] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:41 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1728 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:41.623465 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-94b94069-3840-4d14-b078-f379361a5d0a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:41.624063 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-94b94069-3840-4d14-b078-f379361a5d0a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:41.635599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-94b94069-3840-4d14-b078-f379361a5d0a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:41.635599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-94b94069-3840-4d14-b078-f379361a5d0a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:41.636567 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-94b94069-3840-4d14-b078-f379361a5d0a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:41.637134 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-94b94069-3840-4d14-b078-f379361a5d0a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:41.673760 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-94b94069-3840-4d14-b078-f379361a5d0a tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-volume_attachments/cece49b6-3737-4175-b560-1791b3339fa7" status: 200 len: 194 microversion: 2.1 time: 0.054114 Jun 27 21:21:41.674308 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 353/731] 10.222.0.13 () {58 vars in 1412 bytes} [Mon Jun 27 21:21:41 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-volume_attachments/cece49b6-3737-4175-b560-1791b3339fa7 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:41.685086 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2163c248-cea2-4447-93f5-40e790f56014 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:41.685648 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2163c248-cea2-4447-93f5-40e790f56014 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:41.691918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2163c248-cea2-4447-93f5-40e790f56014 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:41.692640 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2163c248-cea2-4447-93f5-40e790f56014 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:41.693503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2163c248-cea2-4447-93f5-40e790f56014 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:41.693998 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2163c248-cea2-4447-93f5-40e790f56014 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:41.780142 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-2163c248-cea2-4447-93f5-40e790f56014 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lazy-loading 'services' on Instance uuid 624274f6-859f-4e03-9c00-90574d06b2c5 {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:21:41.878140 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2163c248-cea2-4447-93f5-40e790f56014 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "DELETE /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-volume_attachments/cece49b6-3737-4175-b560-1791b3339fa7" status: 202 len: 0 microversion: 2.1 time: 0.197572 Jun 27 21:21:41.878894 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 379/732] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 27 21:21:41 2022] DELETE /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-volume_attachments/cece49b6-3737-4175-b560-1791b3339fa7 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 21:21:42.610164 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-51e09118-529b-45cc-915c-850704560ff5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:42.610670 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-51e09118-529b-45cc-915c-850704560ff5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:42.617685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-51e09118-529b-45cc-915c-850704560ff5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:42.618443 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-51e09118-529b-45cc-915c-850704560ff5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:42.619233 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-51e09118-529b-45cc-915c-850704560ff5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:42.619646 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-51e09118-529b-45cc-915c-850704560ff5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:42.811986 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-51e09118-529b-45cc-915c-850704560ff5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:42.824434 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-51e09118-529b-45cc-915c-850704560ff5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:42.826257 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-51e09118-529b-45cc-915c-850704560ff5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:42.828181 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-51e09118-529b-45cc-915c-850704560ff5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1728 microversion: 2.20 time: 0.222097 Jun 27 21:21:42.841363 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 354/733] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:42 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1728 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:43.849215 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2c5ebc61-b025-4120-bb7e-45621be74be2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:43.849895 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2c5ebc61-b025-4120-bb7e-45621be74be2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:43.864863 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2c5ebc61-b025-4120-bb7e-45621be74be2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:43.865338 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2c5ebc61-b025-4120-bb7e-45621be74be2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:43.866116 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2c5ebc61-b025-4120-bb7e-45621be74be2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:43.866562 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2c5ebc61-b025-4120-bb7e-45621be74be2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:44.134265 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2c5ebc61-b025-4120-bb7e-45621be74be2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:44.154790 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2c5ebc61-b025-4120-bb7e-45621be74be2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:44.161948 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2c5ebc61-b025-4120-bb7e-45621be74be2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:44.174319 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2c5ebc61-b025-4120-bb7e-45621be74be2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1728 microversion: 2.20 time: 0.329787 Jun 27 21:21:44.175212 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 380/734] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:43 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1728 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:45.193262 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-635ffec2-cd4b-4d61-a8e1-07a7b89695ac tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:45.194442 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-635ffec2-cd4b-4d61-a8e1-07a7b89695ac tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:45.206538 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-635ffec2-cd4b-4d61-a8e1-07a7b89695ac tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:45.209093 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-635ffec2-cd4b-4d61-a8e1-07a7b89695ac tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:45.211212 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-635ffec2-cd4b-4d61-a8e1-07a7b89695ac tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:45.213393 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-635ffec2-cd4b-4d61-a8e1-07a7b89695ac tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:45.489888 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-635ffec2-cd4b-4d61-a8e1-07a7b89695ac tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:45.524971 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-635ffec2-cd4b-4d61-a8e1-07a7b89695ac tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:45.526613 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-635ffec2-cd4b-4d61-a8e1-07a7b89695ac tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:45.528376 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-635ffec2-cd4b-4d61-a8e1-07a7b89695ac tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1728 microversion: 2.20 time: 0.338927 Jun 27 21:21:45.529030 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 355/735] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:45 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1728 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:46.547668 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-228a844a-cb3e-427b-a224-6764000b6646 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:46.548943 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-228a844a-cb3e-427b-a224-6764000b6646 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:46.556862 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-228a844a-cb3e-427b-a224-6764000b6646 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:46.568815 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-228a844a-cb3e-427b-a224-6764000b6646 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:46.569983 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-228a844a-cb3e-427b-a224-6764000b6646 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:46.570623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-228a844a-cb3e-427b-a224-6764000b6646 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:46.805340 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-228a844a-cb3e-427b-a224-6764000b6646 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:46.815180 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-228a844a-cb3e-427b-a224-6764000b6646 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:46.817026 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-228a844a-cb3e-427b-a224-6764000b6646 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:46.818244 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-228a844a-cb3e-427b-a224-6764000b6646 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1728 microversion: 2.20 time: 0.274562 Jun 27 21:21:46.829683 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 381/736] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:46 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1728 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:47.838159 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cd63745a-42ec-45e3-891f-2e792ad4b4bc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:47.838830 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cd63745a-42ec-45e3-891f-2e792ad4b4bc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:47.841664 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=54 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:47.851753 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cd63745a-42ec-45e3-891f-2e792ad4b4bc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:47.852234 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cd63745a-42ec-45e3-891f-2e792ad4b4bc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:47.853046 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cd63745a-42ec-45e3-891f-2e792ad4b4bc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:47.853483 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cd63745a-42ec-45e3-891f-2e792ad4b4bc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:48.056215 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cd63745a-42ec-45e3-891f-2e792ad4b4bc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:48.084054 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cd63745a-42ec-45e3-891f-2e792ad4b4bc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:48.087743 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cd63745a-42ec-45e3-891f-2e792ad4b4bc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:48.089833 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cd63745a-42ec-45e3-891f-2e792ad4b4bc tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1728 microversion: 2.20 time: 0.255332 Jun 27 21:21:48.091169 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 356/737] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:47 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1728 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:49.121205 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-45eaead0-ed4a-4cb4-9b45-c9753098e294 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:49.122631 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-45eaead0-ed4a-4cb4-9b45-c9753098e294 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:49.133417 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-45eaead0-ed4a-4cb4-9b45-c9753098e294 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:49.136975 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-45eaead0-ed4a-4cb4-9b45-c9753098e294 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:49.141927 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-45eaead0-ed4a-4cb4-9b45-c9753098e294 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:49.143816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-45eaead0-ed4a-4cb4-9b45-c9753098e294 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:49.314376 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-abbfb604-b4e3-4d47-a9d1-d76b599b4aba tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:49.315804 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-abbfb604-b4e3-4d47-a9d1-d76b599b4aba tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:49.335288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-abbfb604-b4e3-4d47-a9d1-d76b599b4aba tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:49.337274 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-abbfb604-b4e3-4d47-a9d1-d76b599b4aba tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:49.339358 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-abbfb604-b4e3-4d47-a9d1-d76b599b4aba tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:49.341189 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-abbfb604-b4e3-4d47-a9d1-d76b599b4aba tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:49.396566 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-abbfb604-b4e3-4d47-a9d1-d76b599b4aba tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68/ips" status: 200 len: 150 microversion: 2.1 time: 0.595954 Jun 27 21:21:49.397698 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 382/738] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 27 21:21:48 2022] GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68/ips => generated 150 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:50.088173 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-45eaead0-ed4a-4cb4-9b45-c9753098e294 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:50.104137 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-45eaead0-ed4a-4cb4-9b45-c9753098e294 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:50.106340 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-45eaead0-ed4a-4cb4-9b45-c9753098e294 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:50.107551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-45eaead0-ed4a-4cb4-9b45-c9753098e294 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1728 microversion: 2.20 time: 1.003619 Jun 27 21:21:50.108123 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 357/739] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:49 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1728 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:21:51.068028 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e5b9d644-abbd-442d-8039-2b0492b34d82 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "087466a9-9df5-4ff6-b819-e96fecba4cee"}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:51.069352 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e5b9d644-abbd-442d-8039-2b0492b34d82 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:51.083308 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e5b9d644-abbd-442d-8039-2b0492b34d82 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:51.084133 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e5b9d644-abbd-442d-8039-2b0492b34d82 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:51.085143 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e5b9d644-abbd-442d-8039-2b0492b34d82 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:51.086729 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e5b9d644-abbd-442d-8039-2b0492b34d82 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:51.126382 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-78c603df-512a-41e5-99d7-ffab09e9117c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:51.127058 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-78c603df-512a-41e5-99d7-ffab09e9117c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:51.136217 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-78c603df-512a-41e5-99d7-ffab09e9117c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:51.136665 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-78c603df-512a-41e5-99d7-ffab09e9117c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:51.141896 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-78c603df-512a-41e5-99d7-ffab09e9117c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:51.142352 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-78c603df-512a-41e5-99d7-ffab09e9117c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:51.603705 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-78c603df-512a-41e5-99d7-ffab09e9117c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:51.628599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-78c603df-512a-41e5-99d7-ffab09e9117c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:51.641977 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-78c603df-512a-41e5-99d7-ffab09e9117c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:51.643837 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-78c603df-512a-41e5-99d7-ffab09e9117c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1728 microversion: 2.20 time: 0.521747 Jun 27 21:21:51.644568 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 358/740] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:51 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1728 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:21:52.670692 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-eec2344c-f277-4ddb-a3c6-4d687233fb22 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:52.672067 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-eec2344c-f277-4ddb-a3c6-4d687233fb22 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:52.680493 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eec2344c-f277-4ddb-a3c6-4d687233fb22 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:52.681247 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eec2344c-f277-4ddb-a3c6-4d687233fb22 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:52.682259 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eec2344c-f277-4ddb-a3c6-4d687233fb22 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:52.682847 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eec2344c-f277-4ddb-a3c6-4d687233fb22 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:52.862103 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-eec2344c-f277-4ddb-a3c6-4d687233fb22 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:52.873804 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-eec2344c-f277-4ddb-a3c6-4d687233fb22 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:52.880286 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-eec2344c-f277-4ddb-a3c6-4d687233fb22 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:52.883569 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-eec2344c-f277-4ddb-a3c6-4d687233fb22 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1728 microversion: 2.20 time: 0.223646 Jun 27 21:21:52.886053 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 359/741] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:52 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1728 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:53.279030 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e5b9d644-abbd-442d-8039-2b0492b34d82 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "POST /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.219788 Jun 27 21:21:53.279799 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 383/742] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 27 21:21:51 2022] POST /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68/os-volume_attachments => generated 194 bytes in 2224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:53.903593 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-19d061a6-7e2f-4037-94ec-537fda2804f0 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:53.904952 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-19d061a6-7e2f-4037-94ec-537fda2804f0 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:53.918380 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-19d061a6-7e2f-4037-94ec-537fda2804f0 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:53.919253 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-19d061a6-7e2f-4037-94ec-537fda2804f0 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:53.920304 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-19d061a6-7e2f-4037-94ec-537fda2804f0 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:53.921048 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-19d061a6-7e2f-4037-94ec-537fda2804f0 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:54.347357 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-19d061a6-7e2f-4037-94ec-537fda2804f0 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:54.357448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-19d061a6-7e2f-4037-94ec-537fda2804f0 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:54.359305 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-19d061a6-7e2f-4037-94ec-537fda2804f0 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:54.360729 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-19d061a6-7e2f-4037-94ec-537fda2804f0 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1728 microversion: 2.20 time: 0.461745 Jun 27 21:21:54.372794 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 360/743] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:53 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1728 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:54.787428 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7c1ec053-5562-4876-8791-1226285b6b1b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Action: 'create', calling method: .version_select at 0x7f834f19d160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-621371235", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcUq8nBUjBBS1Gm4cEpIfRkJTgpn2Wcy8cgO+C1biICHG/S85Nr0Hn5uH4EjRyNThorI0P4TrQ2/XsRYY59au6849R/OeZdbBGvEs8KnSl2cpJQ/NyIoTgxtn6+msIeHA=="}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:54.802531 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-7c1ec053-5562-4876-8791-1226285b6b1b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Getting quotas for project 824cb65198bf417fbc4baeae349d358d. Resources: {'key_pairs'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:21:54.807494 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-7c1ec053-5562-4876-8791-1226285b6b1b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Getting quotas for user e4b46dc825704fbc9cc2505805f22f94 and project 824cb65198bf417fbc4baeae349d358d. Resources: {'key_pairs'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:21:54.831569 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7c1ec053-5562-4876-8791-1226285b6b1b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.168994 Jun 27 21:21:54.832488 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 384/744] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 27 21:21:54 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:55.233320 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-54a00eee-bbf9-47b6-95c7-a728fc9804ba tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:55.234574 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-54a00eee-bbf9-47b6-95c7-a728fc9804ba tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:55.244199 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54a00eee-bbf9-47b6-95c7-a728fc9804ba tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:55.244918 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54a00eee-bbf9-47b6-95c7-a728fc9804ba tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:55.247331 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54a00eee-bbf9-47b6-95c7-a728fc9804ba tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:55.247652 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54a00eee-bbf9-47b6-95c7-a728fc9804ba tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:55.283503 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-54a00eee-bbf9-47b6-95c7-a728fc9804ba tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055732 Jun 27 21:21:55.283829 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 361/745] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 27 21:21:55 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 21:21:55.382774 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1a26c97c-08e2-4a21-821e-cc3a4777b09a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:55.383885 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1a26c97c-08e2-4a21-821e-cc3a4777b09a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:55.394919 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1a26c97c-08e2-4a21-821e-cc3a4777b09a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:55.395671 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1a26c97c-08e2-4a21-821e-cc3a4777b09a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:55.396966 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1a26c97c-08e2-4a21-821e-cc3a4777b09a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:55.398028 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1a26c97c-08e2-4a21-821e-cc3a4777b09a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:55.422941 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-26e494f0-07a2-4ccb-aa0a-22ba2d910860 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:55.423929 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-26e494f0-07a2-4ccb-aa0a-22ba2d910860 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:55.430865 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-26e494f0-07a2-4ccb-aa0a-22ba2d910860 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:55.431643 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-26e494f0-07a2-4ccb-aa0a-22ba2d910860 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:55.432583 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-26e494f0-07a2-4ccb-aa0a-22ba2d910860 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:55.433204 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-26e494f0-07a2-4ccb-aa0a-22ba2d910860 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:55.474138 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-26e494f0-07a2-4ccb-aa0a-22ba2d910860 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061715 Jun 27 21:21:55.475707 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 362/746] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 27 21:21:55 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 21:21:55.556071 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8cd8d9df-7397-4178-8b4f-d8f56f6ff710 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:55.556810 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8cd8d9df-7397-4178-8b4f-d8f56f6ff710 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:55.566511 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8cd8d9df-7397-4178-8b4f-d8f56f6ff710 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:55.566976 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8cd8d9df-7397-4178-8b4f-d8f56f6ff710 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:55.568038 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8cd8d9df-7397-4178-8b4f-d8f56f6ff710 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:55.568905 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8cd8d9df-7397-4178-8b4f-d8f56f6ff710 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:55.574874 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=95,nova_cell1:UPDATE=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:55.599675 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1a26c97c-08e2-4a21-821e-cc3a4777b09a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:55.611511 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8cd8d9df-7397-4178-8b4f-d8f56f6ff710 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:21:55.612649 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1a26c97c-08e2-4a21-821e-cc3a4777b09a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:55.614546 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1a26c97c-08e2-4a21-821e-cc3a4777b09a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:55.617749 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1a26c97c-08e2-4a21-821e-cc3a4777b09a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1728 microversion: 2.20 time: 0.241409 Jun 27 21:21:55.628503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 385/747] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:55 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1728 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:55.705636 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8cd8d9df-7397-4178-8b4f-d8f56f6ff710 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "DELETE /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5" status: 204 len: 0 microversion: 2.1 time: 0.154833 Jun 27 21:21:55.706621 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 363/748] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:21:55 2022] DELETE /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 21:21:55.719818 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-87f258f3-456f-4062-831d-aa077d20ea86 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:55.720772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-87f258f3-456f-4062-831d-aa077d20ea86 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:55.749497 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-87f258f3-456f-4062-831d-aa077d20ea86 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:55.750167 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-87f258f3-456f-4062-831d-aa077d20ea86 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:55.756410 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-87f258f3-456f-4062-831d-aa077d20ea86 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:55.756892 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-87f258f3-456f-4062-831d-aa077d20ea86 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:55.987949 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-87f258f3-456f-4062-831d-aa077d20ea86 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:56.009468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-87f258f3-456f-4062-831d-aa077d20ea86 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5" status: 200 len: 1673 microversion: 2.1 time: 0.297001 Jun 27 21:21:56.010245 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 386/749] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:55 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 => generated 1673 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:56.636886 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-efa94ce3-a6d8-4dc8-aca8-95197cfbddba tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:56.637608 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-efa94ce3-a6d8-4dc8-aca8-95197cfbddba tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:56.644517 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-efa94ce3-a6d8-4dc8-aca8-95197cfbddba tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:56.644974 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-efa94ce3-a6d8-4dc8-aca8-95197cfbddba tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:56.645972 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-efa94ce3-a6d8-4dc8-aca8-95197cfbddba tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:56.646504 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-efa94ce3-a6d8-4dc8-aca8-95197cfbddba tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:56.816201 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-efa94ce3-a6d8-4dc8-aca8-95197cfbddba tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:56.833705 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-efa94ce3-a6d8-4dc8-aca8-95197cfbddba tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:56.836688 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-efa94ce3-a6d8-4dc8-aca8-95197cfbddba tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:56.838995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-efa94ce3-a6d8-4dc8-aca8-95197cfbddba tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1728 microversion: 2.20 time: 0.206569 Jun 27 21:21:56.839969 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 364/750] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:56 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1728 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:57.035656 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-30aa9358-e9f5-493b-b5d0-ac725f75f4fb tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:57.036368 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-30aa9358-e9f5-493b-b5d0-ac725f75f4fb tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:57.043861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-30aa9358-e9f5-493b-b5d0-ac725f75f4fb tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:57.044294 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-30aa9358-e9f5-493b-b5d0-ac725f75f4fb tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:57.045330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-30aa9358-e9f5-493b-b5d0-ac725f75f4fb tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:57.045750 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-30aa9358-e9f5-493b-b5d0-ac725f75f4fb tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:57.190352 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-30aa9358-e9f5-493b-b5d0-ac725f75f4fb tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:57.198478 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-30aa9358-e9f5-493b-b5d0-ac725f75f4fb tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5" status: 200 len: 1673 microversion: 2.1 time: 0.166700 Jun 27 21:21:57.202917 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 387/751] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:57 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:57.865620 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-370b233d-af79-4d8e-9f8b-3bfdeaf8798c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:57.867211 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-370b233d-af79-4d8e-9f8b-3bfdeaf8798c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:57.885381 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-370b233d-af79-4d8e-9f8b-3bfdeaf8798c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:57.886267 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-370b233d-af79-4d8e-9f8b-3bfdeaf8798c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:57.887715 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-370b233d-af79-4d8e-9f8b-3bfdeaf8798c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:57.888549 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-370b233d-af79-4d8e-9f8b-3bfdeaf8798c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:58.191250 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-370b233d-af79-4d8e-9f8b-3bfdeaf8798c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:58.200098 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-370b233d-af79-4d8e-9f8b-3bfdeaf8798c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:58.201800 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-370b233d-af79-4d8e-9f8b-3bfdeaf8798c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:58.203033 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-370b233d-af79-4d8e-9f8b-3bfdeaf8798c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1728 microversion: 2.20 time: 0.348070 Jun 27 21:21:58.206953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 365/752] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:57 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1728 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:58.221960 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7268ea6b-a7bc-4191-b602-6b9a67ebf9ee tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:58.222388 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7268ea6b-a7bc-4191-b602-6b9a67ebf9ee tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:58.238821 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7268ea6b-a7bc-4191-b602-6b9a67ebf9ee tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:58.239011 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7268ea6b-a7bc-4191-b602-6b9a67ebf9ee tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:58.239795 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7268ea6b-a7bc-4191-b602-6b9a67ebf9ee tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:58.240220 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7268ea6b-a7bc-4191-b602-6b9a67ebf9ee tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:58.259988 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-92383b26-574e-4be1-b6f4-e1d053ceaea3 req-04a1981f-2685-4960-9df3-82e013de2a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a775668d-41e5-407f-ad33-a3b265985d10", "name": "network-vif-plugged", "status": "completed", "tag": "b19d4fbb-0cf8-4c5b-b7e2-ad5cd60e8812"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:58.279222 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-92383b26-574e-4be1-b6f4-e1d053ceaea3 req-04a1981f-2685-4960-9df3-82e013de2a80 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:58.281323 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-92383b26-574e-4be1-b6f4-e1d053ceaea3 req-04a1981f-2685-4960-9df3-82e013de2a80 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:58.304226 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-92383b26-574e-4be1-b6f4-e1d053ceaea3 req-04a1981f-2685-4960-9df3-82e013de2a80 service nova] Creating event network-vif-plugged:b19d4fbb-0cf8-4c5b-b7e2-ad5cd60e8812 for instance a775668d-41e5-407f-ad33-a3b265985d10 on hv-cinder-84773 Jun 27 21:21:58.311635 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-92383b26-574e-4be1-b6f4-e1d053ceaea3 req-04a1981f-2685-4960-9df3-82e013de2a80 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187737 Jun 27 21:21:58.313770 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 388/753] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:58.637206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7268ea6b-a7bc-4191-b602-6b9a67ebf9ee tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:58.688669 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7268ea6b-a7bc-4191-b602-6b9a67ebf9ee tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5" status: 200 len: 1673 microversion: 2.1 time: 0.470256 Jun 27 21:21:58.688889 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 366/754] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:58 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 => generated 1673 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:59.223072 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-83811996-5179-4bc2-af16-6783bda43975 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:59.224650 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-83811996-5179-4bc2-af16-6783bda43975 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:59.233969 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-83811996-5179-4bc2-af16-6783bda43975 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:59.234415 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-83811996-5179-4bc2-af16-6783bda43975 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:59.235423 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-83811996-5179-4bc2-af16-6783bda43975 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:59.236032 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-83811996-5179-4bc2-af16-6783bda43975 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:59.284651 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=91,nova_cell1:UPDATE=5 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:59.385388 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-6f8f1145-cad0-4cfc-a09e-d2748d08b79c req-8182809e-b5ba-4f5d-b6bb-ac904bf98730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "624274f6-859f-4e03-9c00-90574d06b2c5", "name": "network-vif-deleted", "tag": "67ccd3c5-1cc9-425f-a7e3-26606e621d54"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:59.395157 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-6f8f1145-cad0-4cfc-a09e-d2748d08b79c req-8182809e-b5ba-4f5d-b6bb-ac904bf98730 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:59.395759 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-6f8f1145-cad0-4cfc-a09e-d2748d08b79c req-8182809e-b5ba-4f5d-b6bb-ac904bf98730 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:59.423876 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-6f8f1145-cad0-4cfc-a09e-d2748d08b79c req-8182809e-b5ba-4f5d-b6bb-ac904bf98730 service nova] Creating event network-vif-deleted:67ccd3c5-1cc9-425f-a7e3-26606e621d54 for instance 624274f6-859f-4e03-9c00-90574d06b2c5 on hv-cinder-84773 Jun 27 21:21:59.430227 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-6f8f1145-cad0-4cfc-a09e-d2748d08b79c req-8182809e-b5ba-4f5d-b6bb-ac904bf98730 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157369 Jun 27 21:21:59.436324 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 367/755] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:59.508595 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-83811996-5179-4bc2-af16-6783bda43975 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:59.519161 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-83811996-5179-4bc2-af16-6783bda43975 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:59.520863 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-83811996-5179-4bc2-af16-6783bda43975 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:59.523814 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-83811996-5179-4bc2-af16-6783bda43975 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1728 microversion: 2.20 time: 0.304573 Jun 27 21:21:59.525162 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 389/756] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:59 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1728 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:59.712768 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-28597d5f-ad6a-411c-9d62-41ccce907b50 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:59.713516 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-28597d5f-ad6a-411c-9d62-41ccce907b50 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:59.736029 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-28597d5f-ad6a-411c-9d62-41ccce907b50 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:59.736495 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-28597d5f-ad6a-411c-9d62-41ccce907b50 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:59.737314 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-28597d5f-ad6a-411c-9d62-41ccce907b50 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:59.737750 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-28597d5f-ad6a-411c-9d62-41ccce907b50 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:59.832345 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-28597d5f-ad6a-411c-9d62-41ccce907b50 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:59.852189 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-28597d5f-ad6a-411c-9d62-41ccce907b50 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5" status: 200 len: 1321 microversion: 2.1 time: 0.148281 Jun 27 21:21:59.854235 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 368/757] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:59 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:00.543369 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7cae9421-db1d-4db0-a521-10ad238b2d0d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:00.544560 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7cae9421-db1d-4db0-a521-10ad238b2d0d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:00.547424 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:00.553345 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7cae9421-db1d-4db0-a521-10ad238b2d0d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:00.554112 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7cae9421-db1d-4db0-a521-10ad238b2d0d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:00.555960 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7cae9421-db1d-4db0-a521-10ad238b2d0d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:00.556683 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7cae9421-db1d-4db0-a521-10ad238b2d0d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:00.728544 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7cae9421-db1d-4db0-a521-10ad238b2d0d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:00.738052 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7cae9421-db1d-4db0-a521-10ad238b2d0d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:00.739554 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7cae9421-db1d-4db0-a521-10ad238b2d0d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:00.740769 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7cae9421-db1d-4db0-a521-10ad238b2d0d tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1728 microversion: 2.20 time: 0.201516 Jun 27 21:22:00.741592 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 390/758] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:00 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1728 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:00.876640 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-42a8071f-0e33-46a7-b7d8-7891962f1fd3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:00.877358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-42a8071f-0e33-46a7-b7d8-7891962f1fd3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:00.887015 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-42a8071f-0e33-46a7-b7d8-7891962f1fd3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:00.887863 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-42a8071f-0e33-46a7-b7d8-7891962f1fd3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:00.888531 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-42a8071f-0e33-46a7-b7d8-7891962f1fd3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:00.889237 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-42a8071f-0e33-46a7-b7d8-7891962f1fd3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:00.924187 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-42a8071f-0e33-46a7-b7d8-7891962f1fd3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:00.924701 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-42a8071f-0e33-46a7-b7d8-7891962f1fd3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:00.925526 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-42a8071f-0e33-46a7-b7d8-7891962f1fd3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lazy-loading 'fault' on Instance uuid 624274f6-859f-4e03-9c00-90574d06b2c5 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:22:00.973456 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-42a8071f-0e33-46a7-b7d8-7891962f1fd3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7969c6620a0d406890fb4c15b58ab349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c1bcb797ba4eb0ad6daf5ed39baa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:00.981500 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-42a8071f-0e33-46a7-b7d8-7891962f1fd3 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5" status: 200 len: 1326 microversion: 2.1 time: 0.108788 Jun 27 21:22:00.982086 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 369/759] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:00 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 => generated 1326 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:01.760009 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0f4a7c11-dcfa-436e-91db-db844f08988f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:01.760914 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0f4a7c11-dcfa-436e-91db-db844f08988f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:01.768417 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0f4a7c11-dcfa-436e-91db-db844f08988f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:01.769215 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0f4a7c11-dcfa-436e-91db-db844f08988f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:01.769990 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0f4a7c11-dcfa-436e-91db-db844f08988f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:01.770424 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0f4a7c11-dcfa-436e-91db-db844f08988f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:01.935050 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0f4a7c11-dcfa-436e-91db-db844f08988f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:01.943997 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0f4a7c11-dcfa-436e-91db-db844f08988f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:01.945740 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0f4a7c11-dcfa-436e-91db-db844f08988f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:01.946969 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0f4a7c11-dcfa-436e-91db-db844f08988f tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1715 microversion: 2.20 time: 0.191123 Jun 27 21:22:01.947557 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 391/760] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:01 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1715 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:01.999781 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4a2a982a-5ce2-4992-9e9d-e7fdc1896d75 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:02.001152 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4a2a982a-5ce2-4992-9e9d-e7fdc1896d75 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:02.010041 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a2a982a-5ce2-4992-9e9d-e7fdc1896d75 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:02.010231 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a2a982a-5ce2-4992-9e9d-e7fdc1896d75 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:02.011035 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a2a982a-5ce2-4992-9e9d-e7fdc1896d75 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:02.011478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a2a982a-5ce2-4992-9e9d-e7fdc1896d75 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:02.030704 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-4a2a982a-5ce2-4992-9e9d-e7fdc1896d75 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] HTTP exception thrown: Instance 624274f6-859f-4e03-9c00-90574d06b2c5 could not be found. Jun 27 21:22:02.032685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4a2a982a-5ce2-4992-9e9d-e7fdc1896d75 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Request method failure captured: Jun 27 21:22:02.032685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 HTTP/1.1 Jun 27 21:22:02.032685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:22:02.032685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:22:02.032685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:22:02.032685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:22:02.032685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:22:02.032685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:22:02.032685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:22:02.032685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:02.032685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh4VXSvuHVVsVV18DxuCD-1hraSB5lRr2lXGIdjQidFORkIKGXdco8C-CEtj8eV3_hS4IoSB0251skpQY6CgNWafIyRQzVdmoCbZuwzuZJMnrk657v_0p6Qxh-yoz5yhBpt92zaTu8q_575oy3TNlVx3PuQHs9OLBF-opQuTV9AFfXY Jun 27 21:22:02.032685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:22:02.032685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:22:02.032685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:22:02.032685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:22:02.032685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:22:02.032685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:22:02.032685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: d8c1bcb797ba4eb0ad6daf5ed39baa89 Jun 27 21:22:02.032685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeTestJSON-971813324 Jun 27 21:22:02.032685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:22:02.032685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:22:02.034350 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d8c1bcb797ba4eb0ad6daf5ed39baa89", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d8c1bcb797ba4eb0ad6daf5ed39baa89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d8c1bcb797ba4eb0ad6daf5ed39baa89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d8c1bcb797ba4eb0ad6daf5ed39baa89"}]}] Jun 27 21:22:02.034350 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeTestJSON-971813324 Jun 27 21:22:02.034350 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: d8c1bcb797ba4eb0ad6daf5ed39baa89 Jun 27 21:22:02.034350 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeTestJSON-971813324 Jun 27 21:22:02.034350 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeTestJSON-971813324-project Jun 27 21:22:02.034350 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:22:02.034350 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:22:02.034350 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: 7969c6620a0d406890fb4c15b58ab349 Jun 27 21:22:02.034350 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeTestJSON-971813324-project Jun 27 21:22:02.034350 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:22:02.034350 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance 624274f6-859f-4e03-9c00-90574d06b2c5 could not be found. Jun 27 21:22:02.034350 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '624274f6-859f-4e03-9c00-90574d06b2c5'} Jun 27 21:22:02.035277 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:02.035277 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:02.035277 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:02.035277 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:02.035277 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:02.035277 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:02.035277 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:02.035277 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:02.035277 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:02.035277 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:02.035277 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 624274f6-859f-4e03-9c00-90574d06b2c5 could not be found. Jun 27 21:22:02.035277 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:02.035277 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:02.035277 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:02.035277 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:02.035277 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:02.035277 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:02.035277 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:02.035277 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:02.035277 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:02.036597 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:02.036597 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:22:02.036597 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:22:02.036597 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:02.036597 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:02.036597 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:02.036597 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:02.036597 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 624274f6-859f-4e03-9c00-90574d06b2c5 could not be found. Jun 27 21:22:02.036597 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:02.036597 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:02.036597 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:02.036597 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:02.036597 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:02.036597 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:02.036597 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:02.036597 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:02.036597 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 624274f6-859f-4e03-9c00-90574d06b2c5 could not be found. Jun 27 21:22:02.036597 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:02.037944 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4a2a982a-5ce2-4992-9e9d-e7fdc1896d75 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Returning 404 to user: Instance 624274f6-859f-4e03-9c00-90574d06b2c5 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:02.037944 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4a2a982a-5ce2-4992-9e9d-e7fdc1896d75 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5" status: 404 len: 111 microversion: 2.1 time: 0.038854 Jun 27 21:22:02.037944 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 370/761] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:01 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:22:02.043675 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a8df7987-6dd8-4a7d-9b17-91549b97e155 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '.version_select at 0x7f834f1f9430>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:02.075976 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a8df7987-6dd8-4a7d-9b17-91549b97e155 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-473998399" status: 202 len: 0 microversion: 2.1 time: 0.036161 Jun 27 21:22:02.076674 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 392/762] 10.222.0.13 () {58 vars in 1217 bytes} [Mon Jun 27 21:22:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-473998399 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:22:02.193936 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d1db84ff-82ce-4242-86ae-255141b87de3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:02.194436 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d1db84ff-82ce-4242-86ae-255141b87de3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:02.205983 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d1db84ff-82ce-4242-86ae-255141b87de3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:02.207091 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d1db84ff-82ce-4242-86ae-255141b87de3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:02.208638 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d1db84ff-82ce-4242-86ae-255141b87de3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:02.209332 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d1db84ff-82ce-4242-86ae-255141b87de3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:02.318075 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-d1db84ff-82ce-4242-86ae-255141b87de3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lazy-loading 'services' on Instance uuid 3eba84d8-7b64-46aa-94f3-8a58871b0c68 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:22:02.399162 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d1db84ff-82ce-4242-86ae-255141b87de3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68/os-volume_attachments/087466a9-9df5-4ff6-b819-e96fecba4cee" status: 202 len: 0 microversion: 2.1 time: 0.211578 Jun 27 21:22:02.400121 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 371/763] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 27 21:22:02 2022] DELETE /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68/os-volume_attachments/087466a9-9df5-4ff6-b819-e96fecba4cee => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:22:02.412585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2fbedb03-a037-4c83-ab77-3389ff73ccfe tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:02.414097 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2fbedb03-a037-4c83-ab77-3389ff73ccfe tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:02.421947 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2fbedb03-a037-4c83-ab77-3389ff73ccfe tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:02.422666 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2fbedb03-a037-4c83-ab77-3389ff73ccfe tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:02.423726 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2fbedb03-a037-4c83-ab77-3389ff73ccfe tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:02.424372 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2fbedb03-a037-4c83-ab77-3389ff73ccfe tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:02.458632 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2fbedb03-a037-4c83-ab77-3389ff73ccfe tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051984 Jun 27 21:22:02.459181 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 393/764] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 27 21:22:02 2022] GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:22:03.472413 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-abc68b30-1254-42af-a5dd-ff5b248704e3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:03.473578 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-abc68b30-1254-42af-a5dd-ff5b248704e3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:03.480349 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-abc68b30-1254-42af-a5dd-ff5b248704e3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:03.480782 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-abc68b30-1254-42af-a5dd-ff5b248704e3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:03.481601 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-abc68b30-1254-42af-a5dd-ff5b248704e3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:03.482032 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-abc68b30-1254-42af-a5dd-ff5b248704e3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:03.514223 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-abc68b30-1254-42af-a5dd-ff5b248704e3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046772 Jun 27 21:22:03.514810 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 372/765] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 27 21:22:03 2022] GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 21:22:03.576271 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4fa45979-e213-4b08-92d9-ba65d08cc888 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:03.576853 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4fa45979-e213-4b08-92d9-ba65d08cc888 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:03.583973 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4fa45979-e213-4b08-92d9-ba65d08cc888 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:03.584461 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4fa45979-e213-4b08-92d9-ba65d08cc888 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:03.585264 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4fa45979-e213-4b08-92d9-ba65d08cc888 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:03.585768 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4fa45979-e213-4b08-92d9-ba65d08cc888 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:03.613947 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4fa45979-e213-4b08-92d9-ba65d08cc888 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Going to try to terminate instance {{(pid=117891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:22:03.695144 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4fa45979-e213-4b08-92d9-ba65d08cc888 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68" status: 204 len: 0 microversion: 2.1 time: 0.122736 Jun 27 21:22:03.695787 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 394/766] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:22:03 2022] DELETE /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:22:03.704253 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2e4a0fa2-21fb-4303-a241-b61da4a9d00f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:03.704848 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2e4a0fa2-21fb-4303-a241-b61da4a9d00f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:03.711984 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e4a0fa2-21fb-4303-a241-b61da4a9d00f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:03.712424 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e4a0fa2-21fb-4303-a241-b61da4a9d00f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:03.713206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e4a0fa2-21fb-4303-a241-b61da4a9d00f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:03.713628 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e4a0fa2-21fb-4303-a241-b61da4a9d00f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:03.856262 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2e4a0fa2-21fb-4303-a241-b61da4a9d00f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:03.864218 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2e4a0fa2-21fb-4303-a241-b61da4a9d00f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68" status: 200 len: 1682 microversion: 2.1 time: 0.163873 Jun 27 21:22:03.864799 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 373/767] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:03 2022] GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:04.884028 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3afe85af-59b7-4c64-9d8b-3aa540dcf619 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:04.884960 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3afe85af-59b7-4c64-9d8b-3aa540dcf619 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:04.887346 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=4 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:04.893353 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3afe85af-59b7-4c64-9d8b-3aa540dcf619 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:04.893791 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3afe85af-59b7-4c64-9d8b-3aa540dcf619 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:04.894563 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3afe85af-59b7-4c64-9d8b-3aa540dcf619 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:04.894988 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3afe85af-59b7-4c64-9d8b-3aa540dcf619 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:05.033889 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3afe85af-59b7-4c64-9d8b-3aa540dcf619 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:05.043512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3afe85af-59b7-4c64-9d8b-3aa540dcf619 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68" status: 200 len: 1682 microversion: 2.1 time: 0.164017 Jun 27 21:22:05.044081 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 395/768] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:04 2022] GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:05.357043 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d5c86e72-3234-4172-8616-af998ba17bbc tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:05.357596 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d5c86e72-3234-4172-8616-af998ba17bbc tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:05.364124 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d5c86e72-3234-4172-8616-af998ba17bbc tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:05.364565 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d5c86e72-3234-4172-8616-af998ba17bbc tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:05.365358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d5c86e72-3234-4172-8616-af998ba17bbc tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:05.365786 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d5c86e72-3234-4172-8616-af998ba17bbc tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:05.379654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-d5c86e72-3234-4172-8616-af998ba17bbc tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] HTTP exception thrown: Instance 624274f6-859f-4e03-9c00-90574d06b2c5 could not be found. Jun 27 21:22:05.381478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d5c86e72-3234-4172-8616-af998ba17bbc tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Request method failure captured: Jun 27 21:22:05.381478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 HTTP/1.1 Jun 27 21:22:05.381478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:22:05.381478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:22:05.381478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:22:05.381478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:22:05.381478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:22:05.381478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:22:05.381478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:22:05.381478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:05.381478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh4VXSvuHVVsVV18DxuCD-1hraSB5lRr2lXGIdjQidFORkIKGXdco8C-CEtj8eV3_hS4IoSB0251skpQY6CgNWafIyRQzVdmoCbZuwzuZJMnrk657v_0p6Qxh-yoz5yhBpt92zaTu8q_575oy3TNlVx3PuQHs9OLBF-opQuTV9AFfXY Jun 27 21:22:05.381478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:22:05.381478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:22:05.381478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:22:05.381478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:22:05.381478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:22:05.381478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:22:05.381478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: d8c1bcb797ba4eb0ad6daf5ed39baa89 Jun 27 21:22:05.381478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeTestJSON-971813324 Jun 27 21:22:05.381478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:22:05.381478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:22:05.383429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d8c1bcb797ba4eb0ad6daf5ed39baa89", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d8c1bcb797ba4eb0ad6daf5ed39baa89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d8c1bcb797ba4eb0ad6daf5ed39baa89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d8c1bcb797ba4eb0ad6daf5ed39baa89"}]}] Jun 27 21:22:05.383429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeTestJSON-971813324 Jun 27 21:22:05.383429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: d8c1bcb797ba4eb0ad6daf5ed39baa89 Jun 27 21:22:05.383429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeTestJSON-971813324 Jun 27 21:22:05.383429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeTestJSON-971813324-project Jun 27 21:22:05.383429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:22:05.383429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:22:05.383429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: 7969c6620a0d406890fb4c15b58ab349 Jun 27 21:22:05.383429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeTestJSON-971813324-project Jun 27 21:22:05.383429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:22:05.383429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance 624274f6-859f-4e03-9c00-90574d06b2c5 could not be found. Jun 27 21:22:05.383429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '624274f6-859f-4e03-9c00-90574d06b2c5'} Jun 27 21:22:05.384244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:05.384244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:05.384244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:05.384244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:05.384244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:05.384244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:05.384244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:05.384244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:05.384244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:05.384244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:05.384244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 624274f6-859f-4e03-9c00-90574d06b2c5 could not be found. Jun 27 21:22:05.384244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:05.384244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:05.384244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:05.384244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:05.384244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:05.384244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:05.384244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:05.384244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:05.384244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:05.385655 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:05.385655 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 21:22:05.385655 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 21:22:05.385655 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 21:22:05.385655 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 21:22:05.385655 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:05.385655 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:05.385655 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:05.385655 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:05.385655 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 624274f6-859f-4e03-9c00-90574d06b2c5 could not be found. Jun 27 21:22:05.385655 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:05.385655 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:05.385655 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:05.385655 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:05.385655 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:05.385655 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:05.385655 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:05.385655 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:05.385655 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 624274f6-859f-4e03-9c00-90574d06b2c5 could not be found. Jun 27 21:22:05.385655 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:05.387067 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d5c86e72-3234-4172-8616-af998ba17bbc tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Returning 404 to user: Instance 624274f6-859f-4e03-9c00-90574d06b2c5 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:05.387067 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d5c86e72-3234-4172-8616-af998ba17bbc tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "DELETE /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5" status: 404 len: 111 microversion: 2.1 time: 0.031311 Jun 27 21:22:05.387067 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 374/769] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:22:05 2022] DELETE /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:22:05.391480 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-296dd635-f7cf-438a-bb41-11820fe1f376 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:05.392078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-296dd635-f7cf-438a-bb41-11820fe1f376 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 624274f6-859f-4e03-9c00-90574d06b2c5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:05.398401 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-296dd635-f7cf-438a-bb41-11820fe1f376 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:05.398842 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-296dd635-f7cf-438a-bb41-11820fe1f376 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:05.399586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-296dd635-f7cf-438a-bb41-11820fe1f376 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:05.400014 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-296dd635-f7cf-438a-bb41-11820fe1f376 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:05.414409 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-296dd635-f7cf-438a-bb41-11820fe1f376 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] HTTP exception thrown: Instance 624274f6-859f-4e03-9c00-90574d06b2c5 could not be found. Jun 27 21:22:05.416078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-296dd635-f7cf-438a-bb41-11820fe1f376 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Request method failure captured: Jun 27 21:22:05.416078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 HTTP/1.1 Jun 27 21:22:05.416078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:22:05.416078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:22:05.416078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:22:05.416078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:22:05.416078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:22:05.416078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:22:05.416078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:22:05.416078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:05.416078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh4VXSvuHVVsVV18DxuCD-1hraSB5lRr2lXGIdjQidFORkIKGXdco8C-CEtj8eV3_hS4IoSB0251skpQY6CgNWafIyRQzVdmoCbZuwzuZJMnrk657v_0p6Qxh-yoz5yhBpt92zaTu8q_575oy3TNlVx3PuQHs9OLBF-opQuTV9AFfXY Jun 27 21:22:05.416078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:22:05.416078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:22:05.416078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:22:05.416078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:22:05.416078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:22:05.416078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:22:05.416078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: d8c1bcb797ba4eb0ad6daf5ed39baa89 Jun 27 21:22:05.416078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-AttachVolumeTestJSON-971813324 Jun 27 21:22:05.416078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:22:05.416078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:22:05.417642 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d8c1bcb797ba4eb0ad6daf5ed39baa89", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d8c1bcb797ba4eb0ad6daf5ed39baa89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d8c1bcb797ba4eb0ad6daf5ed39baa89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d8c1bcb797ba4eb0ad6daf5ed39baa89"}]}] Jun 27 21:22:05.417642 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-AttachVolumeTestJSON-971813324 Jun 27 21:22:05.417642 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: d8c1bcb797ba4eb0ad6daf5ed39baa89 Jun 27 21:22:05.417642 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-AttachVolumeTestJSON-971813324 Jun 27 21:22:05.417642 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-AttachVolumeTestJSON-971813324-project Jun 27 21:22:05.417642 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:22:05.417642 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:22:05.417642 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: 7969c6620a0d406890fb4c15b58ab349 Jun 27 21:22:05.417642 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-AttachVolumeTestJSON-971813324-project Jun 27 21:22:05.417642 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: > Jun 27 21:22:05.417642 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Instance 624274f6-859f-4e03-9c00-90574d06b2c5 could not be found. Jun 27 21:22:05.417642 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'id': '624274f6-859f-4e03-9c00-90574d06b2c5'} Jun 27 21:22:05.419458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:05.419458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:05.419458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:05.419458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:05.419458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:05.419458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:05.419458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:05.419458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:05.419458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:05.419458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:05.419458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 624274f6-859f-4e03-9c00-90574d06b2c5 could not be found. Jun 27 21:22:05.419458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:05.419458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:05.419458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:05.419458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:05.419458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:05.419458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:05.419458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:05.419458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:05.419458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:05.420948 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:05.420948 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:22:05.420948 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:22:05.420948 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:05.420948 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:05.420948 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:05.420948 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:05.420948 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 624274f6-859f-4e03-9c00-90574d06b2c5 could not be found. Jun 27 21:22:05.420948 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:05.420948 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:05.420948 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:05.420948 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:05.420948 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:05.420948 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:05.420948 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:05.420948 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:05.420948 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 624274f6-859f-4e03-9c00-90574d06b2c5 could not be found. Jun 27 21:22:05.420948 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:05.422050 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-296dd635-f7cf-438a-bb41-11820fe1f376 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Returning 404 to user: Instance 624274f6-859f-4e03-9c00-90574d06b2c5 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:05.422050 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-296dd635-f7cf-438a-bb41-11820fe1f376 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5" status: 404 len: 111 microversion: 2.1 time: 0.029836 Jun 27 21:22:05.422050 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 396/770] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:05 2022] GET /compute/v2.1/servers/624274f6-859f-4e03-9c00-90574d06b2c5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 21:22:06.061298 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f12dcd08-7323-4d8d-8dd2-163b10a0b8b7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:06.062065 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f12dcd08-7323-4d8d-8dd2-163b10a0b8b7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:06.068558 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f12dcd08-7323-4d8d-8dd2-163b10a0b8b7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:06.069044 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f12dcd08-7323-4d8d-8dd2-163b10a0b8b7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:06.069821 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f12dcd08-7323-4d8d-8dd2-163b10a0b8b7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:06.070374 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f12dcd08-7323-4d8d-8dd2-163b10a0b8b7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:06.267814 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f12dcd08-7323-4d8d-8dd2-163b10a0b8b7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff9f1fc84a54b83a7a384965f40c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74724882c84e8f893f5be0f59a9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:06.277388 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f12dcd08-7323-4d8d-8dd2-163b10a0b8b7 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68" status: 200 len: 1682 microversion: 2.1 time: 0.219956 Jun 27 21:22:06.277976 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 375/771] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:06 2022] GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68 => generated 1682 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:06.572615 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d616bd7b-b28e-4b5a-b410-161ab2102451 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:06.573938 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d616bd7b-b28e-4b5a-b410-161ab2102451 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:06.582292 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d616bd7b-b28e-4b5a-b410-161ab2102451 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:06.583191 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d616bd7b-b28e-4b5a-b410-161ab2102451 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:06.584058 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d616bd7b-b28e-4b5a-b410-161ab2102451 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:06.584596 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d616bd7b-b28e-4b5a-b410-161ab2102451 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:06.599810 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-d616bd7b-b28e-4b5a-b410-161ab2102451 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] HTTP exception thrown: Instance 977f8cd5-d96e-4a13-b043-405e5c4325f1 could not be found. Jun 27 21:22:06.601719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d616bd7b-b28e-4b5a-b410-161ab2102451 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Request method failure captured: Jun 27 21:22:06.601719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: DELETE /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 HTTP/1.1 Jun 27 21:22:06.601719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:22:06.601719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:22:06.601719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:22:06.601719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:22:06.601719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:22:06.601719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:22:06.601719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:22:06.601719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:06.601719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh4VXSvuHVVsVV18DxuCD-1hraSB5lRr2lXGIdjQidFORkIKGXdco8C-CEtj8eV3_hS4IoSB0251skpQY6CgNWafIyRQzVdmoCbZuwzuZJMnrk657v_0p6Qxh-yoz5yhBpt92zaTu8q_575oy3TNlVx3PuQHs9OLBF-opQuTV9AFfXY Jun 27 21:22:06.601719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:22:06.601719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:22:06.601719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:22:06.601719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:22:06.601719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:22:06.601719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:22:06.601719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: d8c1bcb797ba4eb0ad6daf5ed39baa89 Jun 27 21:22:06.601719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-AttachVolumeTestJSON-971813324 Jun 27 21:22:06.601719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:22:06.601719 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:22:06.603332 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d8c1bcb797ba4eb0ad6daf5ed39baa89", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d8c1bcb797ba4eb0ad6daf5ed39baa89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d8c1bcb797ba4eb0ad6daf5ed39baa89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d8c1bcb797ba4eb0ad6daf5ed39baa89"}]}] Jun 27 21:22:06.603332 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-AttachVolumeTestJSON-971813324 Jun 27 21:22:06.603332 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: d8c1bcb797ba4eb0ad6daf5ed39baa89 Jun 27 21:22:06.603332 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-AttachVolumeTestJSON-971813324 Jun 27 21:22:06.603332 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-AttachVolumeTestJSON-971813324-project Jun 27 21:22:06.603332 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:22:06.603332 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:22:06.603332 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: 7969c6620a0d406890fb4c15b58ab349 Jun 27 21:22:06.603332 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-AttachVolumeTestJSON-971813324-project Jun 27 21:22:06.603332 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: > Jun 27 21:22:06.603332 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Instance 977f8cd5-d96e-4a13-b043-405e5c4325f1 could not be found. Jun 27 21:22:06.603332 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'id': '977f8cd5-d96e-4a13-b043-405e5c4325f1'} Jun 27 21:22:06.604148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:06.604148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:06.604148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:06.604148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:06.604148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:06.604148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:06.604148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:06.604148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:06.604148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:06.604148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:06.604148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 977f8cd5-d96e-4a13-b043-405e5c4325f1 could not be found. Jun 27 21:22:06.604148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:06.604148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:06.604148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:06.604148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:06.604148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:06.604148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:06.604148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:06.604148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:06.604148 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:06.605585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:06.605585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 21:22:06.605585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 21:22:06.605585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 21:22:06.605585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 21:22:06.605585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:06.605585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:06.605585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:06.605585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:06.605585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 977f8cd5-d96e-4a13-b043-405e5c4325f1 could not be found. Jun 27 21:22:06.605585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:06.605585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:06.605585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:06.605585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:06.605585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:06.605585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:06.605585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:06.605585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:06.605585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 977f8cd5-d96e-4a13-b043-405e5c4325f1 could not be found. Jun 27 21:22:06.605585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:06.608320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d616bd7b-b28e-4b5a-b410-161ab2102451 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Returning 404 to user: Instance 977f8cd5-d96e-4a13-b043-405e5c4325f1 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:06.609387 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d616bd7b-b28e-4b5a-b410-161ab2102451 tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "DELETE /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 404 len: 111 microversion: 2.1 time: 0.041059 Jun 27 21:22:06.610638 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 397/772] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:22:06 2022] DELETE /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:22:06.618854 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-04f08ad4-724c-4d2e-a1ba-d750ce4d4ddd tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:06.620236 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-04f08ad4-724c-4d2e-a1ba-d750ce4d4ddd tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] [instance: 977f8cd5-d96e-4a13-b043-405e5c4325f1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:06.624974 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-5374b067-04d1-40eb-90e6-3d71b99a2b84 req-0add7fb2-0d9d-431b-8bd4-4fa02b7b2c9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eba84d8-7b64-46aa-94f3-8a58871b0c68", "name": "network-vif-deleted", "tag": "cd12e24f-8f5a-4809-bb58-743542a1d988"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:06.628854 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-04f08ad4-724c-4d2e-a1ba-d750ce4d4ddd tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:06.629505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-04f08ad4-724c-4d2e-a1ba-d750ce4d4ddd tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:06.630570 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-04f08ad4-724c-4d2e-a1ba-d750ce4d4ddd tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:06.631265 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-04f08ad4-724c-4d2e-a1ba-d750ce4d4ddd tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:06.635797 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-5374b067-04d1-40eb-90e6-3d71b99a2b84 req-0add7fb2-0d9d-431b-8bd4-4fa02b7b2c9c service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:06.636269 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-5374b067-04d1-40eb-90e6-3d71b99a2b84 req-0add7fb2-0d9d-431b-8bd4-4fa02b7b2c9c service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:06.647428 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-04f08ad4-724c-4d2e-a1ba-d750ce4d4ddd tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] HTTP exception thrown: Instance 977f8cd5-d96e-4a13-b043-405e5c4325f1 could not be found. Jun 27 21:22:06.649580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-04f08ad4-724c-4d2e-a1ba-d750ce4d4ddd tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Request method failure captured: Jun 27 21:22:06.649580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 HTTP/1.1 Jun 27 21:22:06.649580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:22:06.649580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:22:06.649580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:22:06.649580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:22:06.649580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:22:06.649580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:22:06.649580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:22:06.649580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:06.649580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh4VXSvuHVVsVV18DxuCD-1hraSB5lRr2lXGIdjQidFORkIKGXdco8C-CEtj8eV3_hS4IoSB0251skpQY6CgNWafIyRQzVdmoCbZuwzuZJMnrk657v_0p6Qxh-yoz5yhBpt92zaTu8q_575oy3TNlVx3PuQHs9OLBF-opQuTV9AFfXY Jun 27 21:22:06.649580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:22:06.649580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:22:06.649580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:22:06.649580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:22:06.649580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:22:06.649580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:22:06.649580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: d8c1bcb797ba4eb0ad6daf5ed39baa89 Jun 27 21:22:06.649580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeTestJSON-971813324 Jun 27 21:22:06.649580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:22:06.649580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:22:06.650922 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d8c1bcb797ba4eb0ad6daf5ed39baa89", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d8c1bcb797ba4eb0ad6daf5ed39baa89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d8c1bcb797ba4eb0ad6daf5ed39baa89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d8c1bcb797ba4eb0ad6daf5ed39baa89"}]}] Jun 27 21:22:06.650922 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeTestJSON-971813324 Jun 27 21:22:06.650922 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: d8c1bcb797ba4eb0ad6daf5ed39baa89 Jun 27 21:22:06.650922 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeTestJSON-971813324 Jun 27 21:22:06.650922 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeTestJSON-971813324-project Jun 27 21:22:06.650922 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:22:06.650922 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:22:06.650922 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: 7969c6620a0d406890fb4c15b58ab349 Jun 27 21:22:06.650922 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeTestJSON-971813324-project Jun 27 21:22:06.650922 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:22:06.650922 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance 977f8cd5-d96e-4a13-b043-405e5c4325f1 could not be found. Jun 27 21:22:06.650922 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '977f8cd5-d96e-4a13-b043-405e5c4325f1'} Jun 27 21:22:06.651816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:06.651816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:06.651816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:06.651816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:06.651816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:06.651816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:06.651816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:06.651816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:06.651816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:06.651816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:06.651816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 977f8cd5-d96e-4a13-b043-405e5c4325f1 could not be found. Jun 27 21:22:06.651816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:06.651816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:06.651816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:06.651816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:06.651816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:06.651816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:06.651816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:06.651816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:06.651816 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:06.653038 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:06.653038 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:22:06.653038 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:22:06.653038 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:06.653038 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:06.653038 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:06.653038 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:06.653038 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 977f8cd5-d96e-4a13-b043-405e5c4325f1 could not be found. Jun 27 21:22:06.653038 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:06.653038 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:06.653038 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:06.653038 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:06.653038 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:06.653038 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:06.653038 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:06.653038 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:06.653038 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 977f8cd5-d96e-4a13-b043-405e5c4325f1 could not be found. Jun 27 21:22:06.653038 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:06.654200 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-5374b067-04d1-40eb-90e6-3d71b99a2b84 req-0add7fb2-0d9d-431b-8bd4-4fa02b7b2c9c service nova] Creating event network-vif-deleted:cd12e24f-8f5a-4809-bb58-743542a1d988 for instance 3eba84d8-7b64-46aa-94f3-8a58871b0c68 on hv-cinder-84773 Jun 27 21:22:06.655959 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-04f08ad4-724c-4d2e-a1ba-d750ce4d4ddd tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] Returning 404 to user: Instance 977f8cd5-d96e-4a13-b043-405e5c4325f1 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:06.656348 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-5374b067-04d1-40eb-90e6-3d71b99a2b84 req-0add7fb2-0d9d-431b-8bd4-4fa02b7b2c9c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035445 Jun 27 21:22:06.657270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-04f08ad4-724c-4d2e-a1ba-d750ce4d4ddd tempest-AttachVolumeTestJSON-971813324 tempest-AttachVolumeTestJSON-971813324-project] 10.222.0.13 "GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1" status: 404 len: 111 microversion: 2.1 time: 0.042572 Jun 27 21:22:06.658048 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 376/773] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:06 2022] GET /compute/v2.1/servers/977f8cd5-d96e-4a13-b043-405e5c4325f1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:22:06.660402 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 398/774] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:22:07.294401 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3b2220b3-adcf-47ac-8317-23e518fc2947 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:07.295421 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3b2220b3-adcf-47ac-8317-23e518fc2947 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:07.301786 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b2220b3-adcf-47ac-8317-23e518fc2947 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:07.302564 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b2220b3-adcf-47ac-8317-23e518fc2947 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:07.303766 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b2220b3-adcf-47ac-8317-23e518fc2947 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:07.304468 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b2220b3-adcf-47ac-8317-23e518fc2947 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:07.320246 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-3b2220b3-adcf-47ac-8317-23e518fc2947 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] HTTP exception thrown: Instance 3eba84d8-7b64-46aa-94f3-8a58871b0c68 could not be found. Jun 27 21:22:07.322294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3b2220b3-adcf-47ac-8317-23e518fc2947 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Request method failure captured: Jun 27 21:22:07.322294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68 HTTP/1.1 Jun 27 21:22:07.322294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:22:07.322294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:22:07.322294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:22:07.322294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:22:07.322294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:22:07.322294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:22:07.322294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:22:07.322294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:07.322294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh4YqTj0KDKiAA8-Ybj3-gdHviC0IY0gRPX_-zc843y94FxFezSOatXJ1qtJsvtWNZXTTXRx1zonPA_7MuDBpdKOf2Im45jkxvzu24Ha4gAYEuaWcvZ6e6-OgMyPsQ6l_aEAmdX7x7dpM8AjaVFtaQBsb85u09RPN7A4hzw049NiIF4 Jun 27 21:22:07.322294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:22:07.322294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:22:07.322294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:22:07.322294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:22:07.322294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:22:07.322294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:22:07.322294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:22:07.322294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:07.322294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:22:07.322294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:22:07.323798 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a74724882c84e8f893f5be0f59a9581", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}] Jun 27 21:22:07.323798 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:07.323798 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:22:07.323798 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:07.323798 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:22:07.323798 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:22:07.323798 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:22:07.323798 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: fff9f1fc84a54b83a7a384965f40c9d9 Jun 27 21:22:07.323798 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:22:07.323798 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:22:07.323798 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance 3eba84d8-7b64-46aa-94f3-8a58871b0c68 could not be found. Jun 27 21:22:07.323798 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '3eba84d8-7b64-46aa-94f3-8a58871b0c68'} Jun 27 21:22:07.324711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:07.324711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:07.324711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:07.324711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:07.324711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:07.324711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:07.324711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:07.324711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:07.324711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:07.324711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:07.324711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eba84d8-7b64-46aa-94f3-8a58871b0c68 could not be found. Jun 27 21:22:07.324711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:07.324711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:07.324711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:07.324711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:07.324711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:07.324711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:07.324711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:07.324711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:07.324711 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:07.326005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:07.326005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:22:07.326005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:22:07.326005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:07.326005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:07.326005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:07.326005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:07.326005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eba84d8-7b64-46aa-94f3-8a58871b0c68 could not be found. Jun 27 21:22:07.326005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:07.326005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:07.326005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:07.326005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:07.326005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:07.326005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:07.326005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:07.326005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:07.326005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eba84d8-7b64-46aa-94f3-8a58871b0c68 could not be found. Jun 27 21:22:07.326005 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:07.328794 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3b2220b3-adcf-47ac-8317-23e518fc2947 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Returning 404 to user: Instance 3eba84d8-7b64-46aa-94f3-8a58871b0c68 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:07.330164 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3b2220b3-adcf-47ac-8317-23e518fc2947 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68" status: 404 len: 111 microversion: 2.1 time: 0.039676 Jun 27 21:22:07.331046 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 377/775] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:07 2022] GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:22:07.341379 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b91ee907-bee2-4fda-bf22-64d80f195a27 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '.version_select at 0x7f834f19f430>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:07.361389 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b91ee907-bee2-4fda-bf22-64d80f195a27 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-959447349" status: 202 len: 0 microversion: 2.1 time: 0.024078 Jun 27 21:22:07.362341 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 399/776] 10.222.0.13 () {58 vars in 1217 bytes} [Mon Jun 27 21:22:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-959447349 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:22:09.268106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bacdb838-b19f-4bea-b44f-a56a595b5ee3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:09.268673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bacdb838-b19f-4bea-b44f-a56a595b5ee3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:09.276189 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bacdb838-b19f-4bea-b44f-a56a595b5ee3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:09.276697 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bacdb838-b19f-4bea-b44f-a56a595b5ee3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:09.277718 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bacdb838-b19f-4bea-b44f-a56a595b5ee3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:09.278155 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bacdb838-b19f-4bea-b44f-a56a595b5ee3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:09.292607 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-bacdb838-b19f-4bea-b44f-a56a595b5ee3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] HTTP exception thrown: Instance 3eba84d8-7b64-46aa-94f3-8a58871b0c68 could not be found. Jun 27 21:22:09.294228 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bacdb838-b19f-4bea-b44f-a56a595b5ee3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Request method failure captured: Jun 27 21:22:09.294228 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68 HTTP/1.1 Jun 27 21:22:09.294228 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:22:09.294228 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:22:09.294228 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:22:09.294228 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:22:09.294228 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:22:09.294228 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:22:09.294228 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:22:09.294228 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:09.294228 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh4YqTj0KDKiAA8-Ybj3-gdHviC0IY0gRPX_-zc843y94FxFezSOatXJ1qtJsvtWNZXTTXRx1zonPA_7MuDBpdKOf2Im45jkxvzu24Ha4gAYEuaWcvZ6e6-OgMyPsQ6l_aEAmdX7x7dpM8AjaVFtaQBsb85u09RPN7A4hzw049NiIF4 Jun 27 21:22:09.294228 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:22:09.294228 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:22:09.294228 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:22:09.294228 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:22:09.294228 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:22:09.294228 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:22:09.294228 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:22:09.294228 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:09.294228 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:22:09.294228 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:22:09.295853 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a74724882c84e8f893f5be0f59a9581", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}] Jun 27 21:22:09.295853 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:09.295853 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:22:09.295853 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:09.295853 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:22:09.295853 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:22:09.295853 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:22:09.295853 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: fff9f1fc84a54b83a7a384965f40c9d9 Jun 27 21:22:09.295853 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:22:09.295853 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:22:09.295853 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance 3eba84d8-7b64-46aa-94f3-8a58871b0c68 could not be found. Jun 27 21:22:09.295853 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '3eba84d8-7b64-46aa-94f3-8a58871b0c68'} Jun 27 21:22:09.296633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:09.296633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:09.296633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:09.296633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:09.296633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:09.296633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:09.296633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:09.296633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:09.296633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:09.296633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:09.296633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eba84d8-7b64-46aa-94f3-8a58871b0c68 could not be found. Jun 27 21:22:09.296633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:09.296633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:09.296633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:09.296633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:09.296633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:09.296633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:09.296633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:09.296633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:09.296633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:09.297877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:09.297877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 21:22:09.297877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 21:22:09.297877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 21:22:09.297877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 21:22:09.297877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:09.297877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:09.297877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:09.297877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:09.297877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eba84d8-7b64-46aa-94f3-8a58871b0c68 could not be found. Jun 27 21:22:09.297877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:09.297877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:09.297877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:09.297877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:09.297877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:09.297877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:09.297877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:09.297877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:09.297877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eba84d8-7b64-46aa-94f3-8a58871b0c68 could not be found. Jun 27 21:22:09.297877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:09.299029 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bacdb838-b19f-4bea-b44f-a56a595b5ee3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Returning 404 to user: Instance 3eba84d8-7b64-46aa-94f3-8a58871b0c68 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:09.299029 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bacdb838-b19f-4bea-b44f-a56a595b5ee3 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68" status: 404 len: 111 microversion: 2.1 time: 0.031739 Jun 27 21:22:09.299029 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 378/777] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:22:09 2022] DELETE /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:22:09.305126 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c504fbe4-566a-4b22-a34e-8e374f585813 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:09.305864 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c504fbe4-566a-4b22-a34e-8e374f585813 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3eba84d8-7b64-46aa-94f3-8a58871b0c68] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:09.312217 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c504fbe4-566a-4b22-a34e-8e374f585813 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:09.312663 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c504fbe4-566a-4b22-a34e-8e374f585813 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:09.313543 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c504fbe4-566a-4b22-a34e-8e374f585813 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:09.313973 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c504fbe4-566a-4b22-a34e-8e374f585813 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:09.328344 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-c504fbe4-566a-4b22-a34e-8e374f585813 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] HTTP exception thrown: Instance 3eba84d8-7b64-46aa-94f3-8a58871b0c68 could not be found. Jun 27 21:22:09.330062 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c504fbe4-566a-4b22-a34e-8e374f585813 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Request method failure captured: Jun 27 21:22:09.330062 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68 HTTP/1.1 Jun 27 21:22:09.330062 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:22:09.330062 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:22:09.330062 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:22:09.330062 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:22:09.330062 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:22:09.330062 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:22:09.330062 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:22:09.330062 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:09.330062 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh4YqTj0KDKiAA8-Ybj3-gdHviC0IY0gRPX_-zc843y94FxFezSOatXJ1qtJsvtWNZXTTXRx1zonPA_7MuDBpdKOf2Im45jkxvzu24Ha4gAYEuaWcvZ6e6-OgMyPsQ6l_aEAmdX7x7dpM8AjaVFtaQBsb85u09RPN7A4hzw049NiIF4 Jun 27 21:22:09.330062 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:22:09.330062 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:22:09.330062 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:22:09.330062 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:22:09.330062 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:22:09.330062 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:22:09.330062 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:22:09.330062 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:09.330062 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:22:09.330062 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:22:09.331663 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a74724882c84e8f893f5be0f59a9581", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}] Jun 27 21:22:09.331663 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:09.331663 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:22:09.331663 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:09.331663 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:22:09.331663 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:22:09.331663 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:22:09.331663 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: fff9f1fc84a54b83a7a384965f40c9d9 Jun 27 21:22:09.331663 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:22:09.331663 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: > Jun 27 21:22:09.331663 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Instance 3eba84d8-7b64-46aa-94f3-8a58871b0c68 could not be found. Jun 27 21:22:09.331663 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'id': '3eba84d8-7b64-46aa-94f3-8a58871b0c68'} Jun 27 21:22:09.332512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:09.332512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:09.332512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:09.332512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:09.332512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:09.332512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:09.332512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:09.332512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:09.332512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:09.332512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:09.332512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eba84d8-7b64-46aa-94f3-8a58871b0c68 could not be found. Jun 27 21:22:09.332512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:09.332512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:09.332512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:09.332512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:09.332512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:09.332512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:09.332512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:09.332512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:09.332512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:09.334292 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:09.334292 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:22:09.334292 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:22:09.334292 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:09.334292 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:09.334292 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:09.334292 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:09.334292 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eba84d8-7b64-46aa-94f3-8a58871b0c68 could not be found. Jun 27 21:22:09.334292 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:09.334292 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:09.334292 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:09.334292 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:09.334292 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:09.334292 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:09.334292 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:09.334292 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:09.334292 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eba84d8-7b64-46aa-94f3-8a58871b0c68 could not be found. Jun 27 21:22:09.334292 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:09.336375 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c504fbe4-566a-4b22-a34e-8e374f585813 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Returning 404 to user: Instance 3eba84d8-7b64-46aa-94f3-8a58871b0c68 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:09.337280 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c504fbe4-566a-4b22-a34e-8e374f585813 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68" status: 404 len: 111 microversion: 2.1 time: 0.036885 Jun 27 21:22:09.337872 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 400/778] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:09 2022] GET /compute/v2.1/servers/3eba84d8-7b64-46aa-94f3-8a58871b0c68 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:22:10.509845 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a4092bc6-ccc9-430a-8e86-2d6e974cd691 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:10.510465 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a4092bc6-ccc9-430a-8e86-2d6e974cd691 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:10.520029 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a4092bc6-ccc9-430a-8e86-2d6e974cd691 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:10.520522 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a4092bc6-ccc9-430a-8e86-2d6e974cd691 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:10.521367 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a4092bc6-ccc9-430a-8e86-2d6e974cd691 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:10.521997 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a4092bc6-ccc9-430a-8e86-2d6e974cd691 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:10.537672 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-a4092bc6-ccc9-430a-8e86-2d6e974cd691 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] HTTP exception thrown: Instance 397198b2-1a3a-4947-8184-2f3c7a817da9 could not be found. Jun 27 21:22:10.539402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a4092bc6-ccc9-430a-8e86-2d6e974cd691 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Request method failure captured: Jun 27 21:22:10.539402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 HTTP/1.1 Jun 27 21:22:10.539402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:22:10.539402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:22:10.539402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:22:10.539402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:22:10.539402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:22:10.539402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:22:10.539402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:22:10.539402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:10.539402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh4YqTj0KDKiAA8-Ybj3-gdHviC0IY0gRPX_-zc843y94FxFezSOatXJ1qtJsvtWNZXTTXRx1zonPA_7MuDBpdKOf2Im45jkxvzu24Ha4gAYEuaWcvZ6e6-OgMyPsQ6l_aEAmdX7x7dpM8AjaVFtaQBsb85u09RPN7A4hzw049NiIF4 Jun 27 21:22:10.539402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:22:10.539402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:22:10.539402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:22:10.539402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:22:10.539402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:22:10.539402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:22:10.539402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:22:10.539402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:10.539402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:22:10.539402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:22:10.540859 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a74724882c84e8f893f5be0f59a9581", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}] Jun 27 21:22:10.540859 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:10.540859 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:22:10.540859 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:10.540859 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:22:10.540859 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:22:10.540859 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:22:10.540859 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: fff9f1fc84a54b83a7a384965f40c9d9 Jun 27 21:22:10.540859 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:22:10.540859 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:22:10.540859 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance 397198b2-1a3a-4947-8184-2f3c7a817da9 could not be found. Jun 27 21:22:10.540859 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '397198b2-1a3a-4947-8184-2f3c7a817da9'} Jun 27 21:22:10.541861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:10.541861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:10.541861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:10.541861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:10.541861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:10.541861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:10.541861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:10.541861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:10.541861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:10.541861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:10.541861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 397198b2-1a3a-4947-8184-2f3c7a817da9 could not be found. Jun 27 21:22:10.541861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:10.541861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:10.541861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:10.541861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:10.541861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:10.541861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:10.541861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:10.541861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:10.541861 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:10.543333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:10.543333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 21:22:10.543333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 21:22:10.543333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 21:22:10.543333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 21:22:10.543333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:10.543333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:10.543333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:10.543333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:10.543333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 397198b2-1a3a-4947-8184-2f3c7a817da9 could not be found. Jun 27 21:22:10.543333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:10.543333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:10.543333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:10.543333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:10.543333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:10.543333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:10.543333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:10.543333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:10.543333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 397198b2-1a3a-4947-8184-2f3c7a817da9 could not be found. Jun 27 21:22:10.543333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:10.544913 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a4092bc6-ccc9-430a-8e86-2d6e974cd691 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Returning 404 to user: Instance 397198b2-1a3a-4947-8184-2f3c7a817da9 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:10.544913 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a4092bc6-ccc9-430a-8e86-2d6e974cd691 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "DELETE /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9" status: 404 len: 111 microversion: 2.1 time: 0.037459 Jun 27 21:22:10.544913 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 379/779] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:22:10 2022] DELETE /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:22:10.551194 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-618b2258-c479-4290-a797-de392ffc94bc tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:10.551813 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-618b2258-c479-4290-a797-de392ffc94bc tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 397198b2-1a3a-4947-8184-2f3c7a817da9] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:10.559556 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-618b2258-c479-4290-a797-de392ffc94bc tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:10.559861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-618b2258-c479-4290-a797-de392ffc94bc tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:10.560644 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-618b2258-c479-4290-a797-de392ffc94bc tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:10.561082 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-618b2258-c479-4290-a797-de392ffc94bc tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:10.575599 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-618b2258-c479-4290-a797-de392ffc94bc tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] HTTP exception thrown: Instance 397198b2-1a3a-4947-8184-2f3c7a817da9 could not be found. Jun 27 21:22:10.577197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-618b2258-c479-4290-a797-de392ffc94bc tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Request method failure captured: Jun 27 21:22:10.577197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 HTTP/1.1 Jun 27 21:22:10.577197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:22:10.577197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:22:10.577197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:22:10.577197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:22:10.577197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:22:10.577197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:22:10.577197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:22:10.577197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:10.577197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh4YqTj0KDKiAA8-Ybj3-gdHviC0IY0gRPX_-zc843y94FxFezSOatXJ1qtJsvtWNZXTTXRx1zonPA_7MuDBpdKOf2Im45jkxvzu24Ha4gAYEuaWcvZ6e6-OgMyPsQ6l_aEAmdX7x7dpM8AjaVFtaQBsb85u09RPN7A4hzw049NiIF4 Jun 27 21:22:10.577197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:22:10.577197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:22:10.577197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:22:10.577197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:22:10.577197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:22:10.577197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:22:10.577197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:22:10.577197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:10.577197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:22:10.577197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:22:10.578503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a74724882c84e8f893f5be0f59a9581", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}] Jun 27 21:22:10.578503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:10.578503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:22:10.578503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:10.578503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:22:10.578503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:22:10.578503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:22:10.578503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: fff9f1fc84a54b83a7a384965f40c9d9 Jun 27 21:22:10.578503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:22:10.578503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: > Jun 27 21:22:10.578503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Instance 397198b2-1a3a-4947-8184-2f3c7a817da9 could not be found. Jun 27 21:22:10.578503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'id': '397198b2-1a3a-4947-8184-2f3c7a817da9'} Jun 27 21:22:10.579243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:10.579243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:10.579243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:10.579243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:10.579243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:10.579243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:10.579243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:10.579243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:10.579243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:10.579243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:10.579243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 397198b2-1a3a-4947-8184-2f3c7a817da9 could not be found. Jun 27 21:22:10.579243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:10.579243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:10.579243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:10.579243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:10.579243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:10.579243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:10.579243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:10.579243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:10.579243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:10.580506 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:10.580506 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:22:10.580506 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:22:10.580506 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:10.580506 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:10.580506 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:10.580506 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:10.580506 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 397198b2-1a3a-4947-8184-2f3c7a817da9 could not be found. Jun 27 21:22:10.580506 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:10.580506 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:10.580506 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:10.580506 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:10.580506 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:10.580506 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:10.580506 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:10.580506 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:10.580506 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 397198b2-1a3a-4947-8184-2f3c7a817da9 could not be found. Jun 27 21:22:10.580506 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:10.581625 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-618b2258-c479-4290-a797-de392ffc94bc tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Returning 404 to user: Instance 397198b2-1a3a-4947-8184-2f3c7a817da9 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:10.581625 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-618b2258-c479-4290-a797-de392ffc94bc tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9" status: 404 len: 111 microversion: 2.1 time: 0.032117 Jun 27 21:22:10.581625 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 401/780] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:10 2022] GET /compute/v2.1/servers/397198b2-1a3a-4947-8184-2f3c7a817da9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:22:10.588008 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4ca1a23f-2d2a-4629-a680-40fcce5ba395 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:10.588505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4ca1a23f-2d2a-4629-a680-40fcce5ba395 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:10.595213 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ca1a23f-2d2a-4629-a680-40fcce5ba395 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:10.595730 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ca1a23f-2d2a-4629-a680-40fcce5ba395 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:10.596745 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ca1a23f-2d2a-4629-a680-40fcce5ba395 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:10.597254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ca1a23f-2d2a-4629-a680-40fcce5ba395 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:10.611659 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-4ca1a23f-2d2a-4629-a680-40fcce5ba395 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] HTTP exception thrown: Instance 3c5b1522-b5e3-4328-9292-5f99591179a2 could not be found. Jun 27 21:22:10.613406 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4ca1a23f-2d2a-4629-a680-40fcce5ba395 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Request method failure captured: Jun 27 21:22:10.613406 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 HTTP/1.1 Jun 27 21:22:10.613406 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:22:10.613406 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:22:10.613406 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:22:10.613406 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:22:10.613406 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:22:10.613406 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:22:10.613406 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:22:10.613406 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:10.613406 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh4YqTj0KDKiAA8-Ybj3-gdHviC0IY0gRPX_-zc843y94FxFezSOatXJ1qtJsvtWNZXTTXRx1zonPA_7MuDBpdKOf2Im45jkxvzu24Ha4gAYEuaWcvZ6e6-OgMyPsQ6l_aEAmdX7x7dpM8AjaVFtaQBsb85u09RPN7A4hzw049NiIF4 Jun 27 21:22:10.613406 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:22:10.613406 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:22:10.613406 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:22:10.613406 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:22:10.613406 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:22:10.613406 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:22:10.613406 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:22:10.613406 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:10.613406 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:22:10.613406 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:22:10.614954 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a74724882c84e8f893f5be0f59a9581", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}] Jun 27 21:22:10.614954 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:10.614954 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:22:10.614954 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:10.614954 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:22:10.614954 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:22:10.614954 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:22:10.614954 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: fff9f1fc84a54b83a7a384965f40c9d9 Jun 27 21:22:10.614954 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:22:10.614954 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:22:10.614954 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance 3c5b1522-b5e3-4328-9292-5f99591179a2 could not be found. Jun 27 21:22:10.614954 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '3c5b1522-b5e3-4328-9292-5f99591179a2'} Jun 27 21:22:10.615807 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:10.615807 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:10.615807 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:10.615807 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:10.615807 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:10.615807 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:10.615807 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:10.615807 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:10.615807 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:10.615807 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:10.615807 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c5b1522-b5e3-4328-9292-5f99591179a2 could not be found. Jun 27 21:22:10.615807 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:10.615807 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:10.615807 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:10.615807 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:10.615807 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:10.615807 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:10.615807 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:10.615807 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:10.615807 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:10.619147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:10.619147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 21:22:10.619147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 21:22:10.619147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 21:22:10.619147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 21:22:10.619147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:10.619147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:10.619147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:10.619147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:10.619147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c5b1522-b5e3-4328-9292-5f99591179a2 could not be found. Jun 27 21:22:10.619147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:10.619147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:10.619147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:10.619147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:10.619147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:10.619147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:10.619147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:10.619147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:10.619147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c5b1522-b5e3-4328-9292-5f99591179a2 could not be found. Jun 27 21:22:10.619147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:10.620645 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4ca1a23f-2d2a-4629-a680-40fcce5ba395 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Returning 404 to user: Instance 3c5b1522-b5e3-4328-9292-5f99591179a2 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:10.620645 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4ca1a23f-2d2a-4629-a680-40fcce5ba395 tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2" status: 404 len: 111 microversion: 2.1 time: 0.030960 Jun 27 21:22:10.620645 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 380/781] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:22:10 2022] DELETE /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:22:10.623816 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-21a612a6-4a87-42aa-8cda-c16cd14933cb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:10.625314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-21a612a6-4a87-42aa-8cda-c16cd14933cb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: 3c5b1522-b5e3-4328-9292-5f99591179a2] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:10.631025 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-21a612a6-4a87-42aa-8cda-c16cd14933cb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:10.631585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-21a612a6-4a87-42aa-8cda-c16cd14933cb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:10.632299 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-21a612a6-4a87-42aa-8cda-c16cd14933cb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:10.632830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-21a612a6-4a87-42aa-8cda-c16cd14933cb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:10.647900 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-21a612a6-4a87-42aa-8cda-c16cd14933cb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] HTTP exception thrown: Instance 3c5b1522-b5e3-4328-9292-5f99591179a2 could not be found. Jun 27 21:22:10.652312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-21a612a6-4a87-42aa-8cda-c16cd14933cb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Request method failure captured: Jun 27 21:22:10.652312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 HTTP/1.1 Jun 27 21:22:10.652312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:22:10.652312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:22:10.652312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:22:10.652312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:22:10.652312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:22:10.652312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:22:10.652312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:22:10.652312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:10.652312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh4YqTj0KDKiAA8-Ybj3-gdHviC0IY0gRPX_-zc843y94FxFezSOatXJ1qtJsvtWNZXTTXRx1zonPA_7MuDBpdKOf2Im45jkxvzu24Ha4gAYEuaWcvZ6e6-OgMyPsQ6l_aEAmdX7x7dpM8AjaVFtaQBsb85u09RPN7A4hzw049NiIF4 Jun 27 21:22:10.652312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:22:10.652312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:22:10.652312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:22:10.652312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:22:10.652312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:22:10.652312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:22:10.652312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:22:10.652312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:10.652312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:22:10.652312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:22:10.653697 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a74724882c84e8f893f5be0f59a9581", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}] Jun 27 21:22:10.653697 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:10.653697 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:22:10.653697 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:10.653697 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:22:10.653697 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:22:10.653697 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:22:10.653697 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: fff9f1fc84a54b83a7a384965f40c9d9 Jun 27 21:22:10.653697 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:22:10.653697 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: > Jun 27 21:22:10.653697 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Instance 3c5b1522-b5e3-4328-9292-5f99591179a2 could not be found. Jun 27 21:22:10.653697 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'id': '3c5b1522-b5e3-4328-9292-5f99591179a2'} Jun 27 21:22:10.654503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:10.654503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:10.654503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:10.654503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:10.654503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:10.654503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:10.654503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:10.654503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:10.654503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:10.654503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:10.654503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c5b1522-b5e3-4328-9292-5f99591179a2 could not be found. Jun 27 21:22:10.654503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:10.654503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:10.654503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:10.654503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:10.654503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:10.654503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:10.654503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:10.654503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:10.654503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:10.656103 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:10.656103 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:22:10.656103 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:22:10.656103 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:10.656103 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:10.656103 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:10.656103 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:10.656103 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c5b1522-b5e3-4328-9292-5f99591179a2 could not be found. Jun 27 21:22:10.656103 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:10.656103 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:10.656103 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:10.656103 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:10.656103 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:10.656103 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:10.656103 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:10.656103 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:10.656103 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c5b1522-b5e3-4328-9292-5f99591179a2 could not be found. Jun 27 21:22:10.656103 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:10.657199 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-21a612a6-4a87-42aa-8cda-c16cd14933cb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Returning 404 to user: Instance 3c5b1522-b5e3-4328-9292-5f99591179a2 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:10.657199 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-21a612a6-4a87-42aa-8cda-c16cd14933cb tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2" status: 404 len: 111 microversion: 2.1 time: 0.033524 Jun 27 21:22:10.657199 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 402/782] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:10 2022] GET /compute/v2.1/servers/3c5b1522-b5e3-4328-9292-5f99591179a2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:22:11.801289 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-981849d9-e829-4241-800d-b4e92b6694fa tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:11.801846 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-981849d9-e829-4241-800d-b4e92b6694fa tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:11.809115 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-981849d9-e829-4241-800d-b4e92b6694fa tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:11.809550 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-981849d9-e829-4241-800d-b4e92b6694fa tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:11.810309 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-981849d9-e829-4241-800d-b4e92b6694fa tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:11.810742 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-981849d9-e829-4241-800d-b4e92b6694fa tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:11.825592 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-981849d9-e829-4241-800d-b4e92b6694fa tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] HTTP exception thrown: Instance b2a76ab5-ca81-472e-8d89-69e63b684ae3 could not be found. Jun 27 21:22:11.827174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-981849d9-e829-4241-800d-b4e92b6694fa tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Request method failure captured: Jun 27 21:22:11.827174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 HTTP/1.1 Jun 27 21:22:11.827174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:22:11.827174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:22:11.827174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:22:11.827174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:22:11.827174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:22:11.827174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:22:11.827174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:22:11.827174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:11.827174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh4YqTj0KDKiAA8-Ybj3-gdHviC0IY0gRPX_-zc843y94FxFezSOatXJ1qtJsvtWNZXTTXRx1zonPA_7MuDBpdKOf2Im45jkxvzu24Ha4gAYEuaWcvZ6e6-OgMyPsQ6l_aEAmdX7x7dpM8AjaVFtaQBsb85u09RPN7A4hzw049NiIF4 Jun 27 21:22:11.827174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:22:11.827174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:22:11.827174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:22:11.827174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:22:11.827174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:22:11.827174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:22:11.827174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:22:11.827174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:11.827174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:22:11.827174 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:22:11.828639 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a74724882c84e8f893f5be0f59a9581", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}] Jun 27 21:22:11.828639 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:11.828639 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:22:11.828639 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:11.828639 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:22:11.828639 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:22:11.828639 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:22:11.828639 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: fff9f1fc84a54b83a7a384965f40c9d9 Jun 27 21:22:11.828639 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:22:11.828639 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:22:11.828639 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance b2a76ab5-ca81-472e-8d89-69e63b684ae3 could not be found. Jun 27 21:22:11.828639 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': 'b2a76ab5-ca81-472e-8d89-69e63b684ae3'} Jun 27 21:22:11.829673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:11.829673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:11.829673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:11.829673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:11.829673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:11.829673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:11.829673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:11.829673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:11.829673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:11.829673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:11.829673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a76ab5-ca81-472e-8d89-69e63b684ae3 could not be found. Jun 27 21:22:11.829673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:11.829673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:11.829673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:11.829673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:11.829673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:11.829673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:11.829673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:11.829673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:11.829673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:11.831161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:11.831161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 21:22:11.831161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 21:22:11.831161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 21:22:11.831161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 21:22:11.831161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:11.831161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:11.831161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:11.831161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:11.831161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a76ab5-ca81-472e-8d89-69e63b684ae3 could not be found. Jun 27 21:22:11.831161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:11.831161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:11.831161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:11.831161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:11.831161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:11.831161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:11.831161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:11.831161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:11.831161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a76ab5-ca81-472e-8d89-69e63b684ae3 could not be found. Jun 27 21:22:11.831161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:11.833343 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-981849d9-e829-4241-800d-b4e92b6694fa tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Returning 404 to user: Instance b2a76ab5-ca81-472e-8d89-69e63b684ae3 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:11.833343 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-981849d9-e829-4241-800d-b4e92b6694fa tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 404 len: 111 microversion: 2.1 time: 0.031376 Jun 27 21:22:11.833343 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 381/783] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:22:11 2022] DELETE /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:22:11.837801 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4a80d192-561f-4254-a6c9-31d7c4764c0f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:11.838380 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4a80d192-561f-4254-a6c9-31d7c4764c0f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] [instance: b2a76ab5-ca81-472e-8d89-69e63b684ae3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:11.844960 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4a80d192-561f-4254-a6c9-31d7c4764c0f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:11.845426 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4a80d192-561f-4254-a6c9-31d7c4764c0f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:11.846174 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4a80d192-561f-4254-a6c9-31d7c4764c0f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:11.846601 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4a80d192-561f-4254-a6c9-31d7c4764c0f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:11.861879 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-4a80d192-561f-4254-a6c9-31d7c4764c0f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] HTTP exception thrown: Instance b2a76ab5-ca81-472e-8d89-69e63b684ae3 could not be found. Jun 27 21:22:11.863429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4a80d192-561f-4254-a6c9-31d7c4764c0f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Request method failure captured: Jun 27 21:22:11.863429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 HTTP/1.1 Jun 27 21:22:11.863429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:22:11.863429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:22:11.863429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:22:11.863429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:22:11.863429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:22:11.863429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:22:11.863429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:22:11.863429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:11.863429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh4YqTj0KDKiAA8-Ybj3-gdHviC0IY0gRPX_-zc843y94FxFezSOatXJ1qtJsvtWNZXTTXRx1zonPA_7MuDBpdKOf2Im45jkxvzu24Ha4gAYEuaWcvZ6e6-OgMyPsQ6l_aEAmdX7x7dpM8AjaVFtaQBsb85u09RPN7A4hzw049NiIF4 Jun 27 21:22:11.863429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:22:11.863429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:22:11.863429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:22:11.863429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:22:11.863429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:22:11.863429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:22:11.863429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:22:11.863429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:11.863429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:22:11.863429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:22:11.865015 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a74724882c84e8f893f5be0f59a9581", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a74724882c84e8f893f5be0f59a9581"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a74724882c84e8f893f5be0f59a9581"}]}] Jun 27 21:22:11.865015 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:11.865015 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 4a74724882c84e8f893f5be0f59a9581 Jun 27 21:22:11.865015 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993693367 Jun 27 21:22:11.865015 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:22:11.865015 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:22:11.865015 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:22:11.865015 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: fff9f1fc84a54b83a7a384965f40c9d9 Jun 27 21:22:11.865015 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-AttachVolumeNegativeTest-993693367-project Jun 27 21:22:11.865015 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: > Jun 27 21:22:11.865015 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Instance b2a76ab5-ca81-472e-8d89-69e63b684ae3 could not be found. Jun 27 21:22:11.865015 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'id': 'b2a76ab5-ca81-472e-8d89-69e63b684ae3'} Jun 27 21:22:11.865993 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:11.865993 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:11.865993 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:11.865993 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:11.865993 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:11.865993 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:11.865993 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:11.865993 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:11.865993 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:11.865993 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:11.865993 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a76ab5-ca81-472e-8d89-69e63b684ae3 could not be found. Jun 27 21:22:11.865993 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:11.865993 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:11.865993 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:11.865993 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:11.865993 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:11.865993 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:11.865993 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:11.865993 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:11.865993 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:11.868222 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:11.868222 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:22:11.868222 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:22:11.868222 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:11.868222 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:11.868222 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:11.868222 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:11.868222 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a76ab5-ca81-472e-8d89-69e63b684ae3 could not be found. Jun 27 21:22:11.868222 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:11.868222 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:11.868222 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:11.868222 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:11.868222 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:11.868222 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:11.868222 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:11.868222 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:11.868222 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a76ab5-ca81-472e-8d89-69e63b684ae3 could not be found. Jun 27 21:22:11.868222 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:11.869386 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4a80d192-561f-4254-a6c9-31d7c4764c0f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] Returning 404 to user: Instance b2a76ab5-ca81-472e-8d89-69e63b684ae3 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:11.869386 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4a80d192-561f-4254-a6c9-31d7c4764c0f tempest-AttachVolumeNegativeTest-993693367 tempest-AttachVolumeNegativeTest-993693367-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3" status: 404 len: 111 microversion: 2.1 time: 0.035400 Jun 27 21:22:11.872011 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 403/784] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:11 2022] GET /compute/v2.1/servers/b2a76ab5-ca81-472e-8d89-69e63b684ae3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:22:12.987432 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-985b6ed8-e2ed-485c-b17f-8430d9d0cd75 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1395563693", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-621371235", "security_groups": [{"name": "tempest-secgroup-smoke-6158128"}], "block_device_mapping_v2": [{"uuid": "db1dc1d6-5331-41d3-91a8-171dc6013f30", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "09838620-b3d2-4651-acb5-4212286d0e49"}]}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:13.163464 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-985b6ed8-e2ed-485c-b17f-8430d9d0cd75 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] validate_networks() for [('09838620-b3d2-4651-acb5-4212286d0e49', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:22:13.893875 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-985b6ed8-e2ed-485c-b17f-8430d9d0cd75 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:22:13.894499 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-985b6ed8-e2ed-485c-b17f-8430d9d0cd75 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:22:13.895350 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-985b6ed8-e2ed-485c-b17f-8430d9d0cd75 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:22:13.895790 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-985b6ed8-e2ed-485c-b17f-8430d9d0cd75 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:22:13.896402 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-985b6ed8-e2ed-485c-b17f-8430d9d0cd75 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:22:13.906430 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-985b6ed8-e2ed-485c-b17f-8430d9d0cd75 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:13.906870 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-985b6ed8-e2ed-485c-b17f-8430d9d0cd75 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:13.907659 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-985b6ed8-e2ed-485c-b17f-8430d9d0cd75 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:13.908085 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-985b6ed8-e2ed-485c-b17f-8430d9d0cd75 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:13.927332 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-985b6ed8-e2ed-485c-b17f-8430d9d0cd75 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Getting quotas for project 824cb65198bf417fbc4baeae349d358d. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:22:13.932619 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-985b6ed8-e2ed-485c-b17f-8430d9d0cd75 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Getting quotas for user e4b46dc825704fbc9cc2505805f22f94 and project 824cb65198bf417fbc4baeae349d358d. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:22:13.997988 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-985b6ed8-e2ed-485c-b17f-8430d9d0cd75 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:22:14.000533 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-985b6ed8-e2ed-485c-b17f-8430d9d0cd75 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='db1dc1d6-5331-41d3-91a8-171dc6013f30',volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:22:14.169394 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-985b6ed8-e2ed-485c-b17f-8430d9d0cd75 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.185795 Jun 27 21:22:14.175288 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 382/785] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 27 21:22:12 2022] POST /compute/v2.1/servers => generated 403 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:22:14.180975 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9e8b9c4c-a4a1-4bd8-a563-dfa42223df5b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:14.181658 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9e8b9c4c-a4a1-4bd8-a563-dfa42223df5b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:14.374186 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9e8b9c4c-a4a1-4bd8-a563-dfa42223df5b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:14.383364 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9e8b9c4c-a4a1-4bd8-a563-dfa42223df5b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 200 len: 1094 microversion: 2.1 time: 0.206198 Jun 27 21:22:14.384147 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 404/786] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:14 2022] GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 1094 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:15.401520 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-107033af-d340-4479-833c-6cf0f1342c62 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:15.402258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-107033af-d340-4479-833c-6cf0f1342c62 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:15.415514 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-107033af-d340-4479-833c-6cf0f1342c62 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:15.415964 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-107033af-d340-4479-833c-6cf0f1342c62 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:15.416754 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-107033af-d340-4479-833c-6cf0f1342c62 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:15.417376 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-107033af-d340-4479-833c-6cf0f1342c62 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:15.544310 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-107033af-d340-4479-833c-6cf0f1342c62 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:15.548913 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:15.555430 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-107033af-d340-4479-833c-6cf0f1342c62 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 200 len: 1200 microversion: 2.1 time: 0.159503 Jun 27 21:22:15.556868 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 383/787] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:15 2022] GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 1200 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:22:16.572723 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e2860d2b-223b-47d1-baa7-28feed0a32ab tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:16.573443 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e2860d2b-223b-47d1-baa7-28feed0a32ab tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:16.583860 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e2860d2b-223b-47d1-baa7-28feed0a32ab tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:16.584879 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e2860d2b-223b-47d1-baa7-28feed0a32ab tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:16.586835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e2860d2b-223b-47d1-baa7-28feed0a32ab tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:16.587877 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e2860d2b-223b-47d1-baa7-28feed0a32ab tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:16.818422 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e2860d2b-223b-47d1-baa7-28feed0a32ab tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:16.827833 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e2860d2b-223b-47d1-baa7-28feed0a32ab tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 200 len: 1275 microversion: 2.1 time: 0.258284 Jun 27 21:22:16.827833 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 405/788] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:16 2022] GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 1275 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:17.377497 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-4781990d-d085-44e5-856a-ddeb4a888c4b req-29290602-2955-45cd-ad29-b26f8a06a680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0641e731-c003-43d1-93c6-072ca2542d9f", "tag": "75002039-0422-4d26-902e-76319b2a7e3b"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:17.406021 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-4781990d-d085-44e5-856a-ddeb4a888c4b req-29290602-2955-45cd-ad29-b26f8a06a680 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:17.406852 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-4781990d-d085-44e5-856a-ddeb4a888c4b req-29290602-2955-45cd-ad29-b26f8a06a680 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:17.438676 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-4781990d-d085-44e5-856a-ddeb4a888c4b req-29290602-2955-45cd-ad29-b26f8a06a680 service nova] Creating event network-changed:75002039-0422-4d26-902e-76319b2a7e3b for instance 0641e731-c003-43d1-93c6-072ca2542d9f on hv-cinder-84773 Jun 27 21:22:17.453381 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-4781990d-d085-44e5-856a-ddeb4a888c4b req-29290602-2955-45cd-ad29-b26f8a06a680 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082740 Jun 27 21:22:17.454314 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 384/789] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:22:17.844573 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2b2ee3ca-5e89-4d85-b1af-5ade133a8147 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:17.845462 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2b2ee3ca-5e89-4d85-b1af-5ade133a8147 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:17.861789 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2b2ee3ca-5e89-4d85-b1af-5ade133a8147 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:17.862390 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2b2ee3ca-5e89-4d85-b1af-5ade133a8147 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:17.863618 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2b2ee3ca-5e89-4d85-b1af-5ade133a8147 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:17.864394 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2b2ee3ca-5e89-4d85-b1af-5ade133a8147 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:18.042469 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2b2ee3ca-5e89-4d85-b1af-5ade133a8147 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:18.051149 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2b2ee3ca-5e89-4d85-b1af-5ade133a8147 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 200 len: 1263 microversion: 2.1 time: 0.210958 Jun 27 21:22:18.052198 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 406/790] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:17 2022] GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 1263 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:19.070731 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-256a3242-8aa8-474b-b6b0-e9cfc19ff24f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:19.071432 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-256a3242-8aa8-474b-b6b0-e9cfc19ff24f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:19.073464 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:19.080031 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-256a3242-8aa8-474b-b6b0-e9cfc19ff24f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:19.080469 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-256a3242-8aa8-474b-b6b0-e9cfc19ff24f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:19.081281 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-256a3242-8aa8-474b-b6b0-e9cfc19ff24f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:19.081715 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-256a3242-8aa8-474b-b6b0-e9cfc19ff24f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:19.246564 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-256a3242-8aa8-474b-b6b0-e9cfc19ff24f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:19.256706 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-256a3242-8aa8-474b-b6b0-e9cfc19ff24f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 200 len: 1263 microversion: 2.1 time: 0.191042 Jun 27 21:22:19.258134 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 385/791] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:19 2022] GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 1263 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:20.274740 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f98e02c0-8a90-4b25-a26e-7a25afb19b0d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:20.275498 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f98e02c0-8a90-4b25-a26e-7a25afb19b0d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:20.282804 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f98e02c0-8a90-4b25-a26e-7a25afb19b0d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:20.283456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f98e02c0-8a90-4b25-a26e-7a25afb19b0d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:20.285123 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f98e02c0-8a90-4b25-a26e-7a25afb19b0d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:20.285723 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f98e02c0-8a90-4b25-a26e-7a25afb19b0d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:20.492110 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f98e02c0-8a90-4b25-a26e-7a25afb19b0d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:20.501221 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f98e02c0-8a90-4b25-a26e-7a25afb19b0d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 200 len: 1263 microversion: 2.1 time: 0.230659 Jun 27 21:22:20.513166 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 407/792] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:20 2022] GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 1263 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:21.519678 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-45163b17-084c-4469-b618-83bc50828271 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:21.520565 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-45163b17-084c-4469-b618-83bc50828271 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:21.529837 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-45163b17-084c-4469-b618-83bc50828271 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:21.530602 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-45163b17-084c-4469-b618-83bc50828271 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:21.531461 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-45163b17-084c-4469-b618-83bc50828271 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:21.532090 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-45163b17-084c-4469-b618-83bc50828271 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:21.698771 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-45163b17-084c-4469-b618-83bc50828271 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:21.708582 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-45163b17-084c-4469-b618-83bc50828271 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 200 len: 1263 microversion: 2.1 time: 0.193843 Jun 27 21:22:21.709489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 386/793] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:21 2022] GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 1263 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:22.726771 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-978cb4e8-c17e-4854-a71f-242185c55133 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:22.727491 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-978cb4e8-c17e-4854-a71f-242185c55133 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:22.734120 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-978cb4e8-c17e-4854-a71f-242185c55133 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:22.734573 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-978cb4e8-c17e-4854-a71f-242185c55133 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:22.735341 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-978cb4e8-c17e-4854-a71f-242185c55133 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:22.736204 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-978cb4e8-c17e-4854-a71f-242185c55133 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:22.881549 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-978cb4e8-c17e-4854-a71f-242185c55133 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:22.890487 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-978cb4e8-c17e-4854-a71f-242185c55133 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 200 len: 1263 microversion: 2.1 time: 0.167814 Jun 27 21:22:22.891072 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 408/794] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:22 2022] GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 1263 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:23.910473 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cab85159-a5f5-46eb-a438-569cbe4f8afa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:23.911910 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cab85159-a5f5-46eb-a438-569cbe4f8afa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:23.919766 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:23.927472 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cab85159-a5f5-46eb-a438-569cbe4f8afa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:23.928267 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cab85159-a5f5-46eb-a438-569cbe4f8afa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:23.930464 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cab85159-a5f5-46eb-a438-569cbe4f8afa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:23.931031 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cab85159-a5f5-46eb-a438-569cbe4f8afa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:23.939831 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:24.090770 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cab85159-a5f5-46eb-a438-569cbe4f8afa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:24.099225 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cab85159-a5f5-46eb-a438-569cbe4f8afa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 200 len: 1263 microversion: 2.1 time: 0.195373 Jun 27 21:22:24.099921 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 387/795] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:23 2022] GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 1263 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:25.115574 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-01c9a6a7-3d4e-43a4-b4e1-86467815aa9d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:25.116182 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-01c9a6a7-3d4e-43a4-b4e1-86467815aa9d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:25.118678 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:25.124661 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-01c9a6a7-3d4e-43a4-b4e1-86467815aa9d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:25.125135 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-01c9a6a7-3d4e-43a4-b4e1-86467815aa9d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:25.125908 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-01c9a6a7-3d4e-43a4-b4e1-86467815aa9d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:25.126374 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-01c9a6a7-3d4e-43a4-b4e1-86467815aa9d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:25.266300 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-01c9a6a7-3d4e-43a4-b4e1-86467815aa9d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:25.274571 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-01c9a6a7-3d4e-43a4-b4e1-86467815aa9d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 200 len: 1263 microversion: 2.1 time: 0.162677 Jun 27 21:22:25.275172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 409/796] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:25 2022] GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:26.292249 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-812d8370-140d-4072-b99e-6c7491cc7818 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:26.292905 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-812d8370-140d-4072-b99e-6c7491cc7818 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:26.300208 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-812d8370-140d-4072-b99e-6c7491cc7818 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:26.300670 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-812d8370-140d-4072-b99e-6c7491cc7818 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:26.301763 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-812d8370-140d-4072-b99e-6c7491cc7818 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:26.302244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-812d8370-140d-4072-b99e-6c7491cc7818 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:26.465244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-812d8370-140d-4072-b99e-6c7491cc7818 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:26.469388 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-812d8370-140d-4072-b99e-6c7491cc7818 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 200 len: 1263 microversion: 2.1 time: 0.181574 Jun 27 21:22:26.469975 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 388/797] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:26 2022] GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 1263 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:27.486627 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d84a7177-aba8-48ee-bb48-16463b87f9f7 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:27.487312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d84a7177-aba8-48ee-bb48-16463b87f9f7 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:27.494270 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d84a7177-aba8-48ee-bb48-16463b87f9f7 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:27.494709 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d84a7177-aba8-48ee-bb48-16463b87f9f7 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:27.495472 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d84a7177-aba8-48ee-bb48-16463b87f9f7 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:27.495917 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d84a7177-aba8-48ee-bb48-16463b87f9f7 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:27.637555 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d84a7177-aba8-48ee-bb48-16463b87f9f7 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:27.645865 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d84a7177-aba8-48ee-bb48-16463b87f9f7 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 200 len: 1263 microversion: 2.1 time: 0.163445 Jun 27 21:22:27.655468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 410/798] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:27 2022] GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:28.079044 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-2b57429f-c654-4773-8770-7930d8482569 req-9a3cf978-a313-461a-b1aa-8f3b3f1af5be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0641e731-c003-43d1-93c6-072ca2542d9f", "name": "network-vif-plugged", "status": "completed", "tag": "75002039-0422-4d26-902e-76319b2a7e3b"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:28.089351 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-2b57429f-c654-4773-8770-7930d8482569 req-9a3cf978-a313-461a-b1aa-8f3b3f1af5be service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:28.089858 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-2b57429f-c654-4773-8770-7930d8482569 req-9a3cf978-a313-461a-b1aa-8f3b3f1af5be service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:28.111412 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-2b57429f-c654-4773-8770-7930d8482569 req-9a3cf978-a313-461a-b1aa-8f3b3f1af5be service nova] Creating event network-vif-plugged:75002039-0422-4d26-902e-76319b2a7e3b for instance 0641e731-c003-43d1-93c6-072ca2542d9f on hv-cinder-84773 Jun 27 21:22:28.121528 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-2b57429f-c654-4773-8770-7930d8482569 req-9a3cf978-a313-461a-b1aa-8f3b3f1af5be service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046480 Jun 27 21:22:28.122179 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 389/799] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:22:28.663560 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f77e33d7-43a0-4f5e-9112-b01f63cdfd81 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:28.664774 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f77e33d7-43a0-4f5e-9112-b01f63cdfd81 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:28.671962 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f77e33d7-43a0-4f5e-9112-b01f63cdfd81 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:28.672398 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f77e33d7-43a0-4f5e-9112-b01f63cdfd81 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:28.673179 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f77e33d7-43a0-4f5e-9112-b01f63cdfd81 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:28.673604 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f77e33d7-43a0-4f5e-9112-b01f63cdfd81 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:28.814025 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f77e33d7-43a0-4f5e-9112-b01f63cdfd81 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:28.821743 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f77e33d7-43a0-4f5e-9112-b01f63cdfd81 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 200 len: 1263 microversion: 2.1 time: 0.162258 Jun 27 21:22:28.822312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 411/800] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:28 2022] GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:29.840459 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c491cde4-ec4e-4328-a8af-1ded6fffb57f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:29.841394 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c491cde4-ec4e-4328-a8af-1ded6fffb57f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:29.848610 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c491cde4-ec4e-4328-a8af-1ded6fffb57f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:29.849128 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c491cde4-ec4e-4328-a8af-1ded6fffb57f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:29.850176 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c491cde4-ec4e-4328-a8af-1ded6fffb57f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:29.850705 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c491cde4-ec4e-4328-a8af-1ded6fffb57f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:30.013131 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c491cde4-ec4e-4328-a8af-1ded6fffb57f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:30.026037 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c491cde4-ec4e-4328-a8af-1ded6fffb57f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 200 len: 1449 microversion: 2.1 time: 0.190622 Jun 27 21:22:30.026945 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 390/801] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:29 2022] GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 1449 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:30.044064 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4cda6f88-3cf7-47ad-aeb2-6d212c97c1ee tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:30.045286 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4cda6f88-3cf7-47ad-aeb2-6d212c97c1ee tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:30.051823 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4cda6f88-3cf7-47ad-aeb2-6d212c97c1ee tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:30.052261 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4cda6f88-3cf7-47ad-aeb2-6d212c97c1ee tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:30.053047 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4cda6f88-3cf7-47ad-aeb2-6d212c97c1ee tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:30.053469 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4cda6f88-3cf7-47ad-aeb2-6d212c97c1ee tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:30.057934 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:30.192989 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4cda6f88-3cf7-47ad-aeb2-6d212c97c1ee tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:30.201702 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4cda6f88-3cf7-47ad-aeb2-6d212c97c1ee tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 200 len: 1449 microversion: 2.1 time: 0.161357 Jun 27 21:22:30.202542 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 412/802] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:30 2022] GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:32.726352 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-17e145f9-f11e-4cb3-9881-b977f4d716d6 req-d1d0da27-ab30-4634-9d07-ff40bf3297c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0641e731-c003-43d1-93c6-072ca2542d9f", "tag": "75002039-0422-4d26-902e-76319b2a7e3b"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:32.736100 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-17e145f9-f11e-4cb3-9881-b977f4d716d6 req-d1d0da27-ab30-4634-9d07-ff40bf3297c7 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:32.736752 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-17e145f9-f11e-4cb3-9881-b977f4d716d6 req-d1d0da27-ab30-4634-9d07-ff40bf3297c7 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:32.750444 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-17e145f9-f11e-4cb3-9881-b977f4d716d6 req-d1d0da27-ab30-4634-9d07-ff40bf3297c7 service nova] Creating event network-changed:75002039-0422-4d26-902e-76319b2a7e3b for instance 0641e731-c003-43d1-93c6-072ca2542d9f on hv-cinder-84773 Jun 27 21:22:32.755975 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-17e145f9-f11e-4cb3-9881-b977f4d716d6 req-d1d0da27-ab30-4634-9d07-ff40bf3297c7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203461 Jun 27 21:22:32.757318 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 391/803] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:22:35.133523 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-cc0a61aa-dfa0-4ad0-b6d5-a3be0f9ea7a2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:35.134494 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-cc0a61aa-dfa0-4ad0-b6d5-a3be0f9ea7a2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:35.137005 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:35.142588 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cc0a61aa-dfa0-4ad0-b6d5-a3be0f9ea7a2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:35.143026 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cc0a61aa-dfa0-4ad0-b6d5-a3be0f9ea7a2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:35.143783 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cc0a61aa-dfa0-4ad0-b6d5-a3be0f9ea7a2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:35.144209 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cc0a61aa-dfa0-4ad0-b6d5-a3be0f9ea7a2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:35.174808 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-cc0a61aa-dfa0-4ad0-b6d5-a3be0f9ea7a2 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045285 Jun 27 21:22:35.175371 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 413/804] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Jun 27 21:22:35 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:35.237372 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-18e9b8df-946b-4267-ba4a-f9b362b5fb70 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:35.238581 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-18e9b8df-946b-4267-ba4a-f9b362b5fb70 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:35.245277 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18e9b8df-946b-4267-ba4a-f9b362b5fb70 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:35.245710 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18e9b8df-946b-4267-ba4a-f9b362b5fb70 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:35.246456 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18e9b8df-946b-4267-ba4a-f9b362b5fb70 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:35.246891 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18e9b8df-946b-4267-ba4a-f9b362b5fb70 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:35.272271 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-18e9b8df-946b-4267-ba4a-f9b362b5fb70 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:22:35.353842 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-18e9b8df-946b-4267-ba4a-f9b362b5fb70 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 204 len: 0 microversion: 2.20 time: 0.120917 Jun 27 21:22:35.354951 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 392/805] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Jun 27 21:22:35 2022] DELETE /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 27 21:22:35.363359 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b899330d-3a3d-42f8-a660-c0826adfeaae tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:35.363987 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b899330d-3a3d-42f8-a660-c0826adfeaae tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:35.373986 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b899330d-3a3d-42f8-a660-c0826adfeaae tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:35.375030 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b899330d-3a3d-42f8-a660-c0826adfeaae tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:35.375819 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b899330d-3a3d-42f8-a660-c0826adfeaae tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:35.376256 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b899330d-3a3d-42f8-a660-c0826adfeaae tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:35.515445 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b899330d-3a3d-42f8-a660-c0826adfeaae tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:35.524127 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b899330d-3a3d-42f8-a660-c0826adfeaae tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:35.525643 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b899330d-3a3d-42f8-a660-c0826adfeaae tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:35.526831 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b899330d-3a3d-42f8-a660-c0826adfeaae tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1721 microversion: 2.20 time: 0.167618 Jun 27 21:22:35.527414 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 414/806] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:35 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:36.548808 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ab6e312d-d4ea-4980-872e-5e6d50d53ab5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:36.549603 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ab6e312d-d4ea-4980-872e-5e6d50d53ab5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:36.556719 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab6e312d-d4ea-4980-872e-5e6d50d53ab5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:36.557205 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab6e312d-d4ea-4980-872e-5e6d50d53ab5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:36.558009 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab6e312d-d4ea-4980-872e-5e6d50d53ab5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:36.558446 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab6e312d-d4ea-4980-872e-5e6d50d53ab5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:36.730715 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ab6e312d-d4ea-4980-872e-5e6d50d53ab5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:36.739230 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ab6e312d-d4ea-4980-872e-5e6d50d53ab5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:36.740790 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ab6e312d-d4ea-4980-872e-5e6d50d53ab5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:36.742299 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ab6e312d-d4ea-4980-872e-5e6d50d53ab5 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1721 microversion: 2.20 time: 0.198758 Jun 27 21:22:36.742879 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 393/807] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:36 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:37.766089 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-126ac28d-d525-468a-b072-0ada7432c49e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:37.767527 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-126ac28d-d525-468a-b072-0ada7432c49e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:37.774095 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-126ac28d-d525-468a-b072-0ada7432c49e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:37.774552 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-126ac28d-d525-468a-b072-0ada7432c49e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:37.775553 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-126ac28d-d525-468a-b072-0ada7432c49e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:37.775975 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-126ac28d-d525-468a-b072-0ada7432c49e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:37.883852 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-378ac49a-83f1-485d-ae90-5dee6483ad54 req-bf2bc1b6-3ac1-4eda-9999-37a738b62d34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a775668d-41e5-407f-ad33-a3b265985d10", "name": "network-vif-deleted", "tag": "b19d4fbb-0cf8-4c5b-b7e2-ad5cd60e8812"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:37.885211 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-126ac28d-d525-468a-b072-0ada7432c49e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:37.895621 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-378ac49a-83f1-485d-ae90-5dee6483ad54 req-bf2bc1b6-3ac1-4eda-9999-37a738b62d34 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:37.896424 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-378ac49a-83f1-485d-ae90-5dee6483ad54 req-bf2bc1b6-3ac1-4eda-9999-37a738b62d34 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:37.907332 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-126ac28d-d525-468a-b072-0ada7432c49e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:37.913778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-126ac28d-d525-468a-b072-0ada7432c49e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba0127dd69da407ab096773fc9e22530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdaf724b92644a0ae7fbb71147aef40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:37.917732 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-126ac28d-d525-468a-b072-0ada7432c49e tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 200 len: 1653 microversion: 2.20 time: 0.155305 Jun 27 21:22:37.920601 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 415/808] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:37 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 1653 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:37.926268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-378ac49a-83f1-485d-ae90-5dee6483ad54 req-bf2bc1b6-3ac1-4eda-9999-37a738b62d34 service nova] Creating event network-vif-deleted:b19d4fbb-0cf8-4c5b-b7e2-ad5cd60e8812 for instance a775668d-41e5-407f-ad33-a3b265985d10 on hv-cinder-84773 Jun 27 21:22:37.933399 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-378ac49a-83f1-485d-ae90-5dee6483ad54 req-bf2bc1b6-3ac1-4eda-9999-37a738b62d34 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054929 Jun 27 21:22:37.937294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 394/809] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:22:38.940507 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-95edca0b-721c-4296-81f7-aecbdba32a60 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:38.941449 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-95edca0b-721c-4296-81f7-aecbdba32a60 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:38.954282 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-95edca0b-721c-4296-81f7-aecbdba32a60 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:38.955256 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-95edca0b-721c-4296-81f7-aecbdba32a60 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:38.956322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-95edca0b-721c-4296-81f7-aecbdba32a60 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:38.959783 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-95edca0b-721c-4296-81f7-aecbdba32a60 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:38.984130 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-95edca0b-721c-4296-81f7-aecbdba32a60 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] HTTP exception thrown: Instance a775668d-41e5-407f-ad33-a3b265985d10 could not be found. Jun 27 21:22:38.985835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-95edca0b-721c-4296-81f7-aecbdba32a60 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Request method failure captured: Jun 27 21:22:38.985835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 HTTP/1.1 Jun 27 21:22:38.985835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:22:38.985835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:22:38.985835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:22:38.985835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:22:38.985835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:22:38.985835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:22:38.985835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:22:38.985835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:38.985835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh4ij4MXukhTsQNAKHvTHyJFtxeKdT4NwC6Ja1qGf4jY74bgMKzIfBw4fCQFB2OgIPN_rqP1YuXuOBuskMmhRPs0hrdO81hV9tZo9lmNv6aC5B8Ij0gINsAPuvw1-7YZdoiZ2fKp3Lq5N1vfvBIxzRA3_1sjPFvwjKkr0sFgY1h5BzQ Jun 27 21:22:38.985835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:22:38.985835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:22:38.985835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:22:38.985835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:22:38.985835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 21:22:38.985835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:22:38.985835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:22:38.985835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: 0cdaf724b92644a0ae7fbb71147aef40 Jun 27 21:22:38.985835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-133090922 Jun 27 21:22:38.985835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:22:38.985835 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:22:38.988824 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0cdaf724b92644a0ae7fbb71147aef40", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0cdaf724b92644a0ae7fbb71147aef40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0cdaf724b92644a0ae7fbb71147aef40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0cdaf724b92644a0ae7fbb71147aef40"}]}] Jun 27 21:22:38.988824 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-AttachVolumeShelveTestJSON-133090922 Jun 27 21:22:38.988824 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 0cdaf724b92644a0ae7fbb71147aef40 Jun 27 21:22:38.988824 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-133090922 Jun 27 21:22:38.988824 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-AttachVolumeShelveTestJSON-133090922-project Jun 27 21:22:38.988824 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:22:38.988824 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:22:38.988824 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: ba0127dd69da407ab096773fc9e22530 Jun 27 21:22:38.988824 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-AttachVolumeShelveTestJSON-133090922-project Jun 27 21:22:38.988824 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: > Jun 27 21:22:38.988824 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Instance a775668d-41e5-407f-ad33-a3b265985d10 could not be found. Jun 27 21:22:38.988824 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'id': 'a775668d-41e5-407f-ad33-a3b265985d10'} Jun 27 21:22:38.990744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:38.990744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:38.990744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:38.990744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:38.990744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:38.990744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:38.990744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:38.990744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:38.990744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:38.990744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:38.990744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a775668d-41e5-407f-ad33-a3b265985d10 could not be found. Jun 27 21:22:38.990744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:38.990744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:38.990744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:38.990744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:38.990744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:38.990744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:38.990744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:38.990744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:38.990744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:38.993295 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:38.993295 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:22:38.993295 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:22:38.993295 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:38.993295 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:38.993295 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:38.993295 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:38.993295 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a775668d-41e5-407f-ad33-a3b265985d10 could not be found. Jun 27 21:22:38.993295 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:38.993295 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:38.993295 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:38.993295 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:38.993295 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:38.993295 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:38.993295 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:38.993295 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:38.993295 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a775668d-41e5-407f-ad33-a3b265985d10 could not be found. Jun 27 21:22:38.993295 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:38.995240 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-95edca0b-721c-4296-81f7-aecbdba32a60 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Returning 404 to user: Instance a775668d-41e5-407f-ad33-a3b265985d10 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:38.995240 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-95edca0b-721c-4296-81f7-aecbdba32a60 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 404 len: 111 microversion: 2.20 time: 0.051773 Jun 27 21:22:38.995240 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 416/810] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:38 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 21:22:38.999767 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d9fa7346-7368-414b-9607-9fa08369342a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '.version_select at 0x7f8354255820>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:39.033272 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d9fa7346-7368-414b-9607-9fa08369342a tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-59522158" status: 204 len: 0 microversion: 2.20 time: 0.039822 Jun 27 21:22:39.037741 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 395/811] 10.222.0.13 () {60 vars in 1255 bytes} [Mon Jun 27 21:22:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-59522158 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 27 21:22:41.053417 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ecf232bc-6006-44b1-b316-cd443f029f6c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:41.054394 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ecf232bc-6006-44b1-b316-cd443f029f6c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:41.061329 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ecf232bc-6006-44b1-b316-cd443f029f6c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:41.061863 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ecf232bc-6006-44b1-b316-cd443f029f6c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:41.062640 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ecf232bc-6006-44b1-b316-cd443f029f6c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:41.063070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ecf232bc-6006-44b1-b316-cd443f029f6c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:41.078022 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-ecf232bc-6006-44b1-b316-cd443f029f6c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] HTTP exception thrown: Instance a775668d-41e5-407f-ad33-a3b265985d10 could not be found. Jun 27 21:22:41.079403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ecf232bc-6006-44b1-b316-cd443f029f6c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Request method failure captured: Jun 27 21:22:41.079403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: DELETE /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 HTTP/1.1 Jun 27 21:22:41.079403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:22:41.079403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:22:41.079403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:22:41.079403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:22:41.079403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:22:41.079403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:22:41.079403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:22:41.079403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:41.079403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh4ij4MXukhTsQNAKHvTHyJFtxeKdT4NwC6Ja1qGf4jY74bgMKzIfBw4fCQFB2OgIPN_rqP1YuXuOBuskMmhRPs0hrdO81hV9tZo9lmNv6aC5B8Ij0gINsAPuvw1-7YZdoiZ2fKp3Lq5N1vfvBIxzRA3_1sjPFvwjKkr0sFgY1h5BzQ Jun 27 21:22:41.079403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:22:41.079403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:22:41.079403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:22:41.079403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:22:41.079403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 21:22:41.079403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:22:41.079403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:22:41.079403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: 0cdaf724b92644a0ae7fbb71147aef40 Jun 27 21:22:41.079403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-133090922 Jun 27 21:22:41.079403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:22:41.079403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:22:41.081052 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0cdaf724b92644a0ae7fbb71147aef40", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0cdaf724b92644a0ae7fbb71147aef40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0cdaf724b92644a0ae7fbb71147aef40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0cdaf724b92644a0ae7fbb71147aef40"}]}] Jun 27 21:22:41.081052 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-AttachVolumeShelveTestJSON-133090922 Jun 27 21:22:41.081052 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 0cdaf724b92644a0ae7fbb71147aef40 Jun 27 21:22:41.081052 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-133090922 Jun 27 21:22:41.081052 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-AttachVolumeShelveTestJSON-133090922-project Jun 27 21:22:41.081052 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:22:41.081052 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:22:41.081052 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: ba0127dd69da407ab096773fc9e22530 Jun 27 21:22:41.081052 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-AttachVolumeShelveTestJSON-133090922-project Jun 27 21:22:41.081052 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: > Jun 27 21:22:41.081052 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Instance a775668d-41e5-407f-ad33-a3b265985d10 could not be found. Jun 27 21:22:41.081052 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'id': 'a775668d-41e5-407f-ad33-a3b265985d10'} Jun 27 21:22:41.082010 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:41.082010 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:41.082010 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:41.082010 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:41.082010 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:41.082010 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:41.082010 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:41.082010 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:41.082010 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:41.082010 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:41.082010 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a775668d-41e5-407f-ad33-a3b265985d10 could not be found. Jun 27 21:22:41.082010 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:41.082010 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:41.082010 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:41.082010 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:41.082010 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:41.082010 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:41.082010 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:41.082010 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:41.082010 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:41.083805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:41.083805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 21:22:41.083805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 21:22:41.083805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 21:22:41.083805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 21:22:41.083805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:41.083805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:41.083805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:41.083805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:41.083805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a775668d-41e5-407f-ad33-a3b265985d10 could not be found. Jun 27 21:22:41.083805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:41.083805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:41.083805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:41.083805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:41.083805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:41.083805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:41.083805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:41.083805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:41.083805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a775668d-41e5-407f-ad33-a3b265985d10 could not be found. Jun 27 21:22:41.083805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:41.085358 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ecf232bc-6006-44b1-b316-cd443f029f6c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Returning 404 to user: Instance a775668d-41e5-407f-ad33-a3b265985d10 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:41.085358 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ecf232bc-6006-44b1-b316-cd443f029f6c tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 404 len: 111 microversion: 2.20 time: 0.031305 Jun 27 21:22:41.085358 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 417/812] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Jun 27 21:22:41 2022] DELETE /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 21:22:41.091155 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-85cae7cf-1d94-4519-874e-89d3288170be tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:41.091887 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-85cae7cf-1d94-4519-874e-89d3288170be tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: a775668d-41e5-407f-ad33-a3b265985d10] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:41.103947 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-85cae7cf-1d94-4519-874e-89d3288170be tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:41.104397 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-85cae7cf-1d94-4519-874e-89d3288170be tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:41.105186 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-85cae7cf-1d94-4519-874e-89d3288170be tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:41.105617 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-85cae7cf-1d94-4519-874e-89d3288170be tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:41.120118 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-85cae7cf-1d94-4519-874e-89d3288170be tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] HTTP exception thrown: Instance a775668d-41e5-407f-ad33-a3b265985d10 could not be found. Jun 27 21:22:41.122102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-85cae7cf-1d94-4519-874e-89d3288170be tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Request method failure captured: Jun 27 21:22:41.122102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 HTTP/1.1 Jun 27 21:22:41.122102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:22:41.122102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:22:41.122102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:22:41.122102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:22:41.122102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:22:41.122102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:22:41.122102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:22:41.122102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:41.122102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh4ij4MXukhTsQNAKHvTHyJFtxeKdT4NwC6Ja1qGf4jY74bgMKzIfBw4fCQFB2OgIPN_rqP1YuXuOBuskMmhRPs0hrdO81hV9tZo9lmNv6aC5B8Ij0gINsAPuvw1-7YZdoiZ2fKp3Lq5N1vfvBIxzRA3_1sjPFvwjKkr0sFgY1h5BzQ Jun 27 21:22:41.122102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:22:41.122102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:22:41.122102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:22:41.122102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:22:41.122102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 21:22:41.122102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:22:41.122102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:22:41.122102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 0cdaf724b92644a0ae7fbb71147aef40 Jun 27 21:22:41.122102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-133090922 Jun 27 21:22:41.122102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:22:41.122102 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:22:41.125140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0cdaf724b92644a0ae7fbb71147aef40", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0cdaf724b92644a0ae7fbb71147aef40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0cdaf724b92644a0ae7fbb71147aef40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0cdaf724b92644a0ae7fbb71147aef40"}]}] Jun 27 21:22:41.125140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeShelveTestJSON-133090922 Jun 27 21:22:41.125140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 0cdaf724b92644a0ae7fbb71147aef40 Jun 27 21:22:41.125140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-133090922 Jun 27 21:22:41.125140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeShelveTestJSON-133090922-project Jun 27 21:22:41.125140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:22:41.125140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:22:41.125140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: ba0127dd69da407ab096773fc9e22530 Jun 27 21:22:41.125140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeShelveTestJSON-133090922-project Jun 27 21:22:41.125140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:22:41.125140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance a775668d-41e5-407f-ad33-a3b265985d10 could not be found. Jun 27 21:22:41.125140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': 'a775668d-41e5-407f-ad33-a3b265985d10'} Jun 27 21:22:41.126450 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:41.126450 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:41.126450 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:41.126450 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:41.126450 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:41.126450 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:41.126450 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:41.126450 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:41.126450 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:41.126450 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:41.126450 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a775668d-41e5-407f-ad33-a3b265985d10 could not be found. Jun 27 21:22:41.126450 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:41.126450 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:41.126450 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:41.126450 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:41.126450 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:41.126450 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:41.126450 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:41.126450 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:41.126450 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:41.128826 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:41.128826 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:22:41.128826 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:22:41.128826 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:41.128826 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:41.128826 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:41.128826 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:41.128826 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a775668d-41e5-407f-ad33-a3b265985d10 could not be found. Jun 27 21:22:41.128826 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:41.128826 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:41.128826 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:41.128826 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:41.128826 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:41.128826 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:41.128826 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:41.128826 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:41.128826 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a775668d-41e5-407f-ad33-a3b265985d10 could not be found. Jun 27 21:22:41.128826 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:41.131187 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-85cae7cf-1d94-4519-874e-89d3288170be tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Returning 404 to user: Instance a775668d-41e5-407f-ad33-a3b265985d10 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:41.131187 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-85cae7cf-1d94-4519-874e-89d3288170be tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10" status: 404 len: 111 microversion: 2.20 time: 0.037052 Jun 27 21:22:41.131187 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 396/813] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:41 2022] GET /compute/v2.1/servers/a775668d-41e5-407f-ad33-a3b265985d10 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 21:22:42.291496 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c641c044-a65a-4478-9404-7cf357a11d88 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:42.292423 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c641c044-a65a-4478-9404-7cf357a11d88 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:42.299449 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c641c044-a65a-4478-9404-7cf357a11d88 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:42.300195 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c641c044-a65a-4478-9404-7cf357a11d88 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:42.301023 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c641c044-a65a-4478-9404-7cf357a11d88 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:42.301430 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c641c044-a65a-4478-9404-7cf357a11d88 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:42.316465 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-c641c044-a65a-4478-9404-7cf357a11d88 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] HTTP exception thrown: Instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 could not be found. Jun 27 21:22:42.318066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c641c044-a65a-4478-9404-7cf357a11d88 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Request method failure captured: Jun 27 21:22:42.318066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: DELETE /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 HTTP/1.1 Jun 27 21:22:42.318066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:22:42.318066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:22:42.318066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:22:42.318066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:22:42.318066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:22:42.318066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:22:42.318066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:22:42.318066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:42.318066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh4ij4MXukhTsQNAKHvTHyJFtxeKdT4NwC6Ja1qGf4jY74bgMKzIfBw4fCQFB2OgIPN_rqP1YuXuOBuskMmhRPs0hrdO81hV9tZo9lmNv6aC5B8Ij0gINsAPuvw1-7YZdoiZ2fKp3Lq5N1vfvBIxzRA3_1sjPFvwjKkr0sFgY1h5BzQ Jun 27 21:22:42.318066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:22:42.318066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:22:42.318066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:22:42.318066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:22:42.318066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 21:22:42.318066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:22:42.318066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:22:42.318066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: 0cdaf724b92644a0ae7fbb71147aef40 Jun 27 21:22:42.318066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-133090922 Jun 27 21:22:42.318066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:22:42.318066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:22:42.319876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0cdaf724b92644a0ae7fbb71147aef40", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0cdaf724b92644a0ae7fbb71147aef40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0cdaf724b92644a0ae7fbb71147aef40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0cdaf724b92644a0ae7fbb71147aef40"}]}] Jun 27 21:22:42.319876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-AttachVolumeShelveTestJSON-133090922 Jun 27 21:22:42.319876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 0cdaf724b92644a0ae7fbb71147aef40 Jun 27 21:22:42.319876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-133090922 Jun 27 21:22:42.319876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-AttachVolumeShelveTestJSON-133090922-project Jun 27 21:22:42.319876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:22:42.319876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:22:42.319876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: ba0127dd69da407ab096773fc9e22530 Jun 27 21:22:42.319876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-AttachVolumeShelveTestJSON-133090922-project Jun 27 21:22:42.319876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: > Jun 27 21:22:42.319876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 could not be found. Jun 27 21:22:42.319876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'id': '2b28fb7f-5684-4656-bd7c-b6d7d15790b1'} Jun 27 21:22:42.321336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:42.321336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:42.321336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:42.321336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:42.321336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:42.321336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:42.321336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:42.321336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:42.321336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:42.321336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:42.321336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 could not be found. Jun 27 21:22:42.321336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:42.321336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:42.321336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:42.321336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:42.321336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:42.321336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:42.321336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:42.321336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:42.321336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:42.322836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:42.322836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 21:22:42.322836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 21:22:42.322836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 21:22:42.322836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 21:22:42.322836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:42.322836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:42.322836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:42.322836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:42.322836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 could not be found. Jun 27 21:22:42.322836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:42.322836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:42.322836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:42.322836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:42.322836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:42.322836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:42.322836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:42.322836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:42.322836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 could not be found. Jun 27 21:22:42.322836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:42.324177 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c641c044-a65a-4478-9404-7cf357a11d88 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Returning 404 to user: Instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:42.324177 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c641c044-a65a-4478-9404-7cf357a11d88 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 404 len: 111 microversion: 2.20 time: 0.032882 Jun 27 21:22:42.324177 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 418/814] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Jun 27 21:22:42 2022] DELETE /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 21:22:42.328183 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-06306c58-f92e-4da2-97de-6ffa05010bd0 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:42.328764 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-06306c58-f92e-4da2-97de-6ffa05010bd0 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] [instance: 2b28fb7f-5684-4656-bd7c-b6d7d15790b1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:42.336035 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-06306c58-f92e-4da2-97de-6ffa05010bd0 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:42.336479 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-06306c58-f92e-4da2-97de-6ffa05010bd0 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:42.337281 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-06306c58-f92e-4da2-97de-6ffa05010bd0 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:42.337717 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-06306c58-f92e-4da2-97de-6ffa05010bd0 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:42.351701 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-06306c58-f92e-4da2-97de-6ffa05010bd0 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] HTTP exception thrown: Instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 could not be found. Jun 27 21:22:42.353287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-06306c58-f92e-4da2-97de-6ffa05010bd0 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Request method failure captured: Jun 27 21:22:42.353287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 HTTP/1.1 Jun 27 21:22:42.353287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:22:42.353287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:22:42.353287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:22:42.353287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:22:42.353287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:22:42.353287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:22:42.353287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:22:42.353287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:42.353287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh4ij4MXukhTsQNAKHvTHyJFtxeKdT4NwC6Ja1qGf4jY74bgMKzIfBw4fCQFB2OgIPN_rqP1YuXuOBuskMmhRPs0hrdO81hV9tZo9lmNv6aC5B8Ij0gINsAPuvw1-7YZdoiZ2fKp3Lq5N1vfvBIxzRA3_1sjPFvwjKkr0sFgY1h5BzQ Jun 27 21:22:42.353287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:22:42.353287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:22:42.353287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:22:42.353287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:22:42.353287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 21:22:42.353287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:22:42.353287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:22:42.353287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 0cdaf724b92644a0ae7fbb71147aef40 Jun 27 21:22:42.353287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-133090922 Jun 27 21:22:42.353287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:22:42.353287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:22:42.354994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0cdaf724b92644a0ae7fbb71147aef40", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0cdaf724b92644a0ae7fbb71147aef40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0cdaf724b92644a0ae7fbb71147aef40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0cdaf724b92644a0ae7fbb71147aef40"}]}] Jun 27 21:22:42.354994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeShelveTestJSON-133090922 Jun 27 21:22:42.354994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 0cdaf724b92644a0ae7fbb71147aef40 Jun 27 21:22:42.354994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-133090922 Jun 27 21:22:42.354994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeShelveTestJSON-133090922-project Jun 27 21:22:42.354994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:22:42.354994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:22:42.354994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: ba0127dd69da407ab096773fc9e22530 Jun 27 21:22:42.354994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeShelveTestJSON-133090922-project Jun 27 21:22:42.354994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:22:42.354994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 could not be found. Jun 27 21:22:42.354994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '2b28fb7f-5684-4656-bd7c-b6d7d15790b1'} Jun 27 21:22:42.355783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:42.355783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:42.355783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:42.355783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:42.355783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:42.355783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:42.355783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:42.355783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:42.355783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:42.355783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:42.355783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 could not be found. Jun 27 21:22:42.355783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:42.355783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:42.355783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:42.355783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:42.355783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:42.355783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:42.355783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:42.355783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:42.355783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:42.357155 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:42.357155 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:22:42.357155 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:22:42.357155 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:42.357155 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:42.357155 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:42.357155 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:42.357155 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 could not be found. Jun 27 21:22:42.357155 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:42.357155 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:42.357155 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:42.357155 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:42.357155 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:42.357155 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:42.357155 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:42.357155 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:42.357155 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 could not be found. Jun 27 21:22:42.357155 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:42.358322 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-06306c58-f92e-4da2-97de-6ffa05010bd0 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] Returning 404 to user: Instance 2b28fb7f-5684-4656-bd7c-b6d7d15790b1 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:42.358322 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-06306c58-f92e-4da2-97de-6ffa05010bd0 tempest-AttachVolumeShelveTestJSON-133090922 tempest-AttachVolumeShelveTestJSON-133090922-project] 10.222.0.13 "GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1" status: 404 len: 111 microversion: 2.20 time: 0.030604 Jun 27 21:22:42.365087 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 397/815] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:42 2022] GET /compute/v2.1/servers/2b28fb7f-5684-4656-bd7c-b6d7d15790b1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 21:22:45.705556 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-307c55f2-3256-4a97-a497-03195cf34b50 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1781383494", "imageRef": "3155f228-b1ff-487e-837f-85eec68c250a", "flavorRef": "452", "networks": [{"uuid": "d80fed7e-ca08-478c-bcce-00fe66ce3ab4"}]}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:45.791878 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.network.neutron [None req-307c55f2-3256-4a97-a497-03195cf34b50 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] validate_networks() for [('d80fed7e-ca08-478c-bcce-00fe66ce3ab4', None, None, None, None, None)] {{(pid=117891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:22:46.360874 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-307c55f2-3256-4a97-a497-03195cf34b50 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Flavor limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:22:46.361796 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-307c55f2-3256-4a97-a497-03195cf34b50 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Image limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:22:46.362297 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-307c55f2-3256-4a97-a497-03195cf34b50 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Flavor pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:22:46.362852 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-307c55f2-3256-4a97-a497-03195cf34b50 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Image pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:22:46.363432 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-307c55f2-3256-4a97-a497-03195cf34b50 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:22:46.374174 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-307c55f2-3256-4a97-a497-03195cf34b50 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:46.374902 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-307c55f2-3256-4a97-a497-03195cf34b50 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:46.375824 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-307c55f2-3256-4a97-a497-03195cf34b50 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:46.376351 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-307c55f2-3256-4a97-a497-03195cf34b50 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:46.394592 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-307c55f2-3256-4a97-a497-03195cf34b50 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Getting quotas for project 8b70340671074b2aa4c80384cb6f1c85. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:22:46.399479 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-307c55f2-3256-4a97-a497-03195cf34b50 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Getting quotas for user e0e171895ccc4f1cbc69ead21175fc5d and project 8b70340671074b2aa4c80384cb6f1c85. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:22:46.413643 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-307c55f2-3256-4a97-a497-03195cf34b50 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Going to run 1 instances... {{(pid=117891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:22:46.416080 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-307c55f2-3256-4a97-a497-03195cf34b50 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: b7dedf72-564d-4542-ae8e-626f445758d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3155f228-b1ff-487e-837f-85eec68c250a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:22:46.470661 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-307c55f2-3256-4a97-a497-03195cf34b50 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.769233 Jun 27 21:22:46.471273 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 419/816] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 27 21:22:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:22:46.481686 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a5255ba3-c9e3-4076-9509-113e1c178864 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:46.488135 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a5255ba3-c9e3-4076-9509-113e1c178864 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: b7dedf72-564d-4542-ae8e-626f445758d6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:46.572268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a5255ba3-c9e3-4076-9509-113e1c178864 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:46.580640 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a5255ba3-c9e3-4076-9509-113e1c178864 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6" status: 200 len: 1214 microversion: 2.1 time: 0.102152 Jun 27 21:22:46.583198 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 398/817] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:46 2022] GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6 => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:47.599927 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-fbe643c2-619b-4648-8d88-38845b467dc7 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:47.601628 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-fbe643c2-619b-4648-8d88-38845b467dc7 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: b7dedf72-564d-4542-ae8e-626f445758d6] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:47.611716 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fbe643c2-619b-4648-8d88-38845b467dc7 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:47.612125 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fbe643c2-619b-4648-8d88-38845b467dc7 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:47.613138 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fbe643c2-619b-4648-8d88-38845b467dc7 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:47.613558 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fbe643c2-619b-4648-8d88-38845b467dc7 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:47.690135 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-fbe643c2-619b-4648-8d88-38845b467dc7 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:47.698084 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-fbe643c2-619b-4648-8d88-38845b467dc7 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6" status: 200 len: 1274 microversion: 2.1 time: 0.102723 Jun 27 21:22:47.699599 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 420/818] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:47 2022] GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6 => generated 1274 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:47.861573 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d8f8c726-33c5-44eb-9589-bec052e4aa2f tempest-VolumesGetTestJSON-1335054476 tempest-VolumesGetTestJSON-1335054476-project] Action: 'create', calling method: .version_select at 0x7f83541ce040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2035998945", "metadata": {"Type": "work"}}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:48.208166 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d8f8c726-33c5-44eb-9589-bec052e4aa2f tempest-VolumesGetTestJSON-1335054476 tempest-VolumesGetTestJSON-1335054476-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.512759 Jun 27 21:22:48.209407 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 399/819] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Jun 27 21:22:47 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 515 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 27 21:22:48.221021 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-abc2712b-efe2-4949-8555-4f33e8b55faf tempest-VolumesGetTestJSON-1335054476 tempest-VolumesGetTestJSON-1335054476-project] Calling method '.version_select at 0x7f834f1c2dc0>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:48.290775 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-abc2712b-efe2-4949-8555-4f33e8b55faf tempest-VolumesGetTestJSON-1335054476 tempest-VolumesGetTestJSON-1335054476-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/4d2c5d34-9916-4a46-a812-15a01bc98709" status: 200 len: 353 microversion: 2.1 time: 0.073572 Jun 27 21:22:48.291845 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 421/820] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 27 21:22:48 2022] GET /compute/v2.1/os-volumes/4d2c5d34-9916-4a46-a812-15a01bc98709 => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:22:48.718180 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a5eac619-6db0-4398-9061-07024bedc6e7 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:48.719222 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a5eac619-6db0-4398-9061-07024bedc6e7 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: b7dedf72-564d-4542-ae8e-626f445758d6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:48.730262 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a5eac619-6db0-4398-9061-07024bedc6e7 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:48.731035 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a5eac619-6db0-4398-9061-07024bedc6e7 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:48.731958 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a5eac619-6db0-4398-9061-07024bedc6e7 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:48.732547 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a5eac619-6db0-4398-9061-07024bedc6e7 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:48.738831 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:49.001436 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a5eac619-6db0-4398-9061-07024bedc6e7 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:49.009433 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a5eac619-6db0-4398-9061-07024bedc6e7 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6" status: 200 len: 1314 microversion: 2.1 time: 0.297160 Jun 27 21:22:49.010037 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 400/821] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:48 2022] GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:49.305445 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-972c889d-b85c-497c-a222-f7865b82d0c1 tempest-VolumesGetTestJSON-1335054476 tempest-VolumesGetTestJSON-1335054476-project] Calling method '.version_select at 0x7f834f19daf0>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:49.354880 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-972c889d-b85c-497c-a222-f7865b82d0c1 tempest-VolumesGetTestJSON-1335054476 tempest-VolumesGetTestJSON-1335054476-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/4d2c5d34-9916-4a46-a812-15a01bc98709" status: 200 len: 354 microversion: 2.1 time: 0.054906 Jun 27 21:22:49.355862 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 422/822] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 27 21:22:49 2022] GET /compute/v2.1/os-volumes/4d2c5d34-9916-4a46-a812-15a01bc98709 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:22:49.367385 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-46ef0be2-d5ad-4166-b84f-06bcbfd94355 tempest-VolumesGetTestJSON-1335054476 tempest-VolumesGetTestJSON-1335054476-project] Calling method '.version_select at 0x7f835426b430>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:49.393720 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-67d5454d-2528-46b3-9672-2e936340f93d req-7ac2de35-ec48-4d11-b95b-03e6f052d6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7dedf72-564d-4542-ae8e-626f445758d6", "tag": "cc340891-83ed-4294-b526-d713283c7b21"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:49.407254 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-67d5454d-2528-46b3-9672-2e936340f93d req-7ac2de35-ec48-4d11-b95b-03e6f052d6b2 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:49.408609 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-67d5454d-2528-46b3-9672-2e936340f93d req-7ac2de35-ec48-4d11-b95b-03e6f052d6b2 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:49.420871 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-67d5454d-2528-46b3-9672-2e936340f93d req-7ac2de35-ec48-4d11-b95b-03e6f052d6b2 service nova] Creating event network-changed:cc340891-83ed-4294-b526-d713283c7b21 for instance b7dedf72-564d-4542-ae8e-626f445758d6 on hv-cinder-84773 Jun 27 21:22:49.425172 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-46ef0be2-d5ad-4166-b84f-06bcbfd94355 tempest-VolumesGetTestJSON-1335054476 tempest-VolumesGetTestJSON-1335054476-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/4d2c5d34-9916-4a46-a812-15a01bc98709" status: 200 len: 354 microversion: 2.1 time: 0.061933 Jun 27 21:22:49.425752 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 401/823] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 27 21:22:49 2022] GET /compute/v2.1/os-volumes/4d2c5d34-9916-4a46-a812-15a01bc98709 => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:22:49.435704 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-67d5454d-2528-46b3-9672-2e936340f93d req-7ac2de35-ec48-4d11-b95b-03e6f052d6b2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037362 Jun 27 21:22:49.435704 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 423/824] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:22:49.443429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-80e1e9a1-b266-429f-99c7-e0afd001d22e tempest-VolumesGetTestJSON-1335054476 tempest-VolumesGetTestJSON-1335054476-project] Calling method '.version_select at 0x7f834f170550>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:49.515081 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-80e1e9a1-b266-429f-99c7-e0afd001d22e tempest-VolumesGetTestJSON-1335054476 tempest-VolumesGetTestJSON-1335054476-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/4d2c5d34-9916-4a46-a812-15a01bc98709" status: 202 len: 0 microversion: 2.1 time: 0.077322 Jun 27 21:22:49.515681 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 424/825] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 27 21:22:49 2022] DELETE /compute/v2.1/os-volumes/4d2c5d34-9916-4a46-a812-15a01bc98709 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 21:22:49.523992 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-41db261c-03ce-484b-86de-852084086f64 tempest-VolumesGetTestJSON-1335054476 tempest-VolumesGetTestJSON-1335054476-project] Calling method '.version_select at 0x7f835423ee50>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:49.577211 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-41db261c-03ce-484b-86de-852084086f64 tempest-VolumesGetTestJSON-1335054476 tempest-VolumesGetTestJSON-1335054476-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/4d2c5d34-9916-4a46-a812-15a01bc98709" status: 200 len: 353 microversion: 2.1 time: 0.057118 Jun 27 21:22:49.577791 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 402/826] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 27 21:22:49 2022] GET /compute/v2.1/os-volumes/4d2c5d34-9916-4a46-a812-15a01bc98709 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:22:50.026952 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-cf39a424-41bd-47cd-ba56-88c5d4c99bd8 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:50.027688 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-cf39a424-41bd-47cd-ba56-88c5d4c99bd8 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: b7dedf72-564d-4542-ae8e-626f445758d6] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:50.034342 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cf39a424-41bd-47cd-ba56-88c5d4c99bd8 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:50.034778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cf39a424-41bd-47cd-ba56-88c5d4c99bd8 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:50.035539 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cf39a424-41bd-47cd-ba56-88c5d4c99bd8 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:50.035966 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cf39a424-41bd-47cd-ba56-88c5d4c99bd8 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:50.171692 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-cf39a424-41bd-47cd-ba56-88c5d4c99bd8 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:50.181087 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-cf39a424-41bd-47cd-ba56-88c5d4c99bd8 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6" status: 200 len: 1314 microversion: 2.1 time: 0.157886 Jun 27 21:22:50.181735 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 425/827] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:50 2022] GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:50.591332 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-51111625-ab11-4d1a-aa4d-8f526b2c56b1 tempest-VolumesGetTestJSON-1335054476 tempest-VolumesGetTestJSON-1335054476-project] Calling method '.version_select at 0x7f835433b1f0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:50.622006 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-51111625-ab11-4d1a-aa4d-8f526b2c56b1 tempest-VolumesGetTestJSON-1335054476 tempest-VolumesGetTestJSON-1335054476-project] HTTP exception thrown: Volume 4d2c5d34-9916-4a46-a812-15a01bc98709 could not be found. Jun 27 21:22:50.623998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-51111625-ab11-4d1a-aa4d-8f526b2c56b1 tempest-VolumesGetTestJSON-1335054476 tempest-VolumesGetTestJSON-1335054476-project] Request method failure captured: Jun 27 21:22:50.623998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/os-volumes/4d2c5d34-9916-4a46-a812-15a01bc98709 HTTP/1.1 Jun 27 21:22:50.623998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:22:50.623998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:22:50.623998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:22:50.623998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:22:50.623998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:22:50.623998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:22:50.623998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:22:50.623998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:50.623998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh-nB3YOM97YgV82sS6jqxovRD1D25yp_NM37kEuIgOOEevoeCCVLcZgI99cmF-GfUzdh19CB_47N5jul08P9Qy0D44uFdtJ73HoG-ffDEtKqf7-id0cnZ3sKafPK5hrWylgxSVE5JonthoOZCYFknBa9hWkfDoXAUO1_RdvcHwI7hI Jun 27 21:22:50.623998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:22:50.623998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:22:50.623998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:22:50.623998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:22:50.623998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:22:50.623998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:22:50.623998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 083acc51fd7842fc893ebd00da3c64dc Jun 27 21:22:50.623998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesGetTestJSON-1335054476 Jun 27 21:22:50.623998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:22:50.623998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:22:50.625649 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_083acc51fd7842fc893ebd00da3c64dc", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/083acc51fd7842fc893ebd00da3c64dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/083acc51fd7842fc893ebd00da3c64dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/083acc51fd7842fc893ebd00da3c64dc"}]}] Jun 27 21:22:50.625649 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesGetTestJSON-1335054476 Jun 27 21:22:50.625649 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 083acc51fd7842fc893ebd00da3c64dc Jun 27 21:22:50.625649 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesGetTestJSON-1335054476 Jun 27 21:22:50.625649 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesGetTestJSON-1335054476-project Jun 27 21:22:50.625649 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:22:50.625649 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:22:50.625649 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: 0dd47d03d78a4349bb3fb3dc0a0100c5 Jun 27 21:22:50.625649 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesGetTestJSON-1335054476-project Jun 27 21:22:50.625649 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: Jun 27 21:22:50.625649 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Volume 4d2c5d34-9916-4a46-a812-15a01bc98709 could not be found. Jun 27 21:22:50.625649 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '4d2c5d34-9916-4a46-a812-15a01bc98709'} Jun 27 21:22:50.625649 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:50.626592 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:50.626592 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:22:50.626592 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:22:50.626592 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 21:22:50.626592 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 21:22:50.626592 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 21:22:50.626592 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 21:22:50.626592 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 21:22:50.626592 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 21:22:50.626592 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 21:22:50.626592 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 21:22:50.626592 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:22:50.626592 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:22:50.626592 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:22:50.626592 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:22:50.626592 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4d2c5d34-9916-4a46-a812-15a01bc98709 could not be found. (HTTP 404) (Request-ID: req-3d1d13ad-ea07-4382-a1db-35b0ad157930) Jun 27 21:22:50.626592 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:50.626592 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:50.626592 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:50.627801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:50.627801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 21:22:50.627801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 21:22:50.627801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 21:22:50.627801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 21:22:50.627801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 21:22:50.627801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 21:22:50.627801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 21:22:50.627801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 21:22:50.627801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:22:50.627801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:22:50.627801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 21:22:50.627801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 21:22:50.627801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 21:22:50.627801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 21:22:50.627801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 21:22:50.627801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 21:22:50.627801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 21:22:50.627801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 21:22:50.628995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:22:50.628995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:22:50.628995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:22:50.628995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:22:50.628995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4d2c5d34-9916-4a46-a812-15a01bc98709 could not be found. Jun 27 21:22:50.628995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:50.628995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:50.628995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:50.628995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:50.628995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:50.628995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:50.628995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:50.628995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:50.628995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 21:22:50.628995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 21:22:50.628995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:50.628995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:50.628995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 21:22:50.628995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:50.630448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4d2c5d34-9916-4a46-a812-15a01bc98709 could not be found. Jun 27 21:22:50.630448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:50.630448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:50.630448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:50.630448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:50.630448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:50.630448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:50.630448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:50.630448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:50.630448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4d2c5d34-9916-4a46-a812-15a01bc98709 could not be found. Jun 27 21:22:50.630448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:50.630448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-51111625-ab11-4d1a-aa4d-8f526b2c56b1 tempest-VolumesGetTestJSON-1335054476 tempest-VolumesGetTestJSON-1335054476-project] Returning 404 to user: Volume 4d2c5d34-9916-4a46-a812-15a01bc98709 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:50.630448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-51111625-ab11-4d1a-aa4d-8f526b2c56b1 tempest-VolumesGetTestJSON-1335054476 tempest-VolumesGetTestJSON-1335054476-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/4d2c5d34-9916-4a46-a812-15a01bc98709" status: 404 len: 109 microversion: 2.1 time: 0.038738 Jun 27 21:22:50.630448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 403/828] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 27 21:22:50 2022] GET /compute/v2.1/os-volumes/4d2c5d34-9916-4a46-a812-15a01bc98709 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:22:51.199069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0f249fff-2d06-4d3f-980a-e209c2cb7a24 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:51.199773 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0f249fff-2d06-4d3f-980a-e209c2cb7a24 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: b7dedf72-564d-4542-ae8e-626f445758d6] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:51.207799 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0f249fff-2d06-4d3f-980a-e209c2cb7a24 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:51.208266 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0f249fff-2d06-4d3f-980a-e209c2cb7a24 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:51.209063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0f249fff-2d06-4d3f-980a-e209c2cb7a24 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:51.209483 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0f249fff-2d06-4d3f-980a-e209c2cb7a24 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:51.837057 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0f249fff-2d06-4d3f-980a-e209c2cb7a24 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:51.845077 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0f249fff-2d06-4d3f-980a-e209c2cb7a24 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6" status: 200 len: 1314 microversion: 2.1 time: 0.650285 Jun 27 21:22:51.845662 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 426/829] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:51 2022] GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6 => generated 1314 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:52.449932 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0f71c5da-2de7-4975-adf5-30493067efd5 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:52.450663 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0f71c5da-2de7-4975-adf5-30493067efd5 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:52.455609 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-44e7e493-3b5a-4d40-9eb6-fdb807bf98ad req-32adcf49-29bc-4242-8161-2cce2b14f452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9323a6ac-3a15-471a-b676-eb3e809a8637", "tag": "36112ae1-bee5-4df6-9469-82c6af7bb1f4"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:52.462999 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:52.467492 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f71c5da-2de7-4975-adf5-30493067efd5 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:52.467886 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f71c5da-2de7-4975-adf5-30493067efd5 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:52.468868 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f71c5da-2de7-4975-adf5-30493067efd5 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:52.469295 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f71c5da-2de7-4975-adf5-30493067efd5 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:52.471291 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-44e7e493-3b5a-4d40-9eb6-fdb807bf98ad req-32adcf49-29bc-4242-8161-2cce2b14f452 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:52.471737 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-44e7e493-3b5a-4d40-9eb6-fdb807bf98ad req-32adcf49-29bc-4242-8161-2cce2b14f452 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:52.497218 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-44e7e493-3b5a-4d40-9eb6-fdb807bf98ad req-32adcf49-29bc-4242-8161-2cce2b14f452 service nova] Creating event network-changed:36112ae1-bee5-4df6-9469-82c6af7bb1f4 for instance 9323a6ac-3a15-471a-b676-eb3e809a8637 on hv-cinder-84773 Jun 27 21:22:52.503601 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-44e7e493-3b5a-4d40-9eb6-fdb807bf98ad req-32adcf49-29bc-4242-8161-2cce2b14f452 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051718 Jun 27 21:22:52.503807 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0f71c5da-2de7-4975-adf5-30493067efd5 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:22:52.508753 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 427/830] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:22:52.629854 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0f71c5da-2de7-4975-adf5-30493067efd5 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 204 len: 0 microversion: 2.1 time: 0.186022 Jun 27 21:22:52.631149 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 404/831] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:22:52 2022] DELETE /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:22:52.641131 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-67fb23a7-3c9f-46eb-85f9-822c49c8683a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:52.641909 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-67fb23a7-3c9f-46eb-85f9-822c49c8683a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:52.649919 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-67fb23a7-3c9f-46eb-85f9-822c49c8683a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:52.650730 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-67fb23a7-3c9f-46eb-85f9-822c49c8683a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:52.651856 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-67fb23a7-3c9f-46eb-85f9-822c49c8683a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:52.652548 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-67fb23a7-3c9f-46eb-85f9-822c49c8683a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:52.822820 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-67fb23a7-3c9f-46eb-85f9-822c49c8683a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:52.824106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-000015de-67a0-401d-beb8-c550d10a64b3 tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] Action: 'create', calling method: .version_select at 0x7f8354255c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-219053808", "metadata": {"Type": "work"}}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:52.831211 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-67fb23a7-3c9f-46eb-85f9-822c49c8683a tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1567 microversion: 2.1 time: 0.194539 Jun 27 21:22:52.831768 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 428/832] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:52 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:52.844106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-000015de-67a0-401d-beb8-c550d10a64b3 tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] Request method failure captured: Jun 27 21:22:52.844106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 27 21:22:52.844106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:22:52.844106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:22:52.844106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:22:52.844106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 121 Jun 27 21:22:52.844106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:22:52.844106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:22:52.844106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:22:52.844106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:52.844106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh-s9BqHcN-rpZJkVXCPkYm9Wnxm6SP9pMdoThyvjk2OgFbRAAjh_6BJOo-_FUmRoaar8rvaBgJzaqybHbcxhGVyfcANBzfM9zLmKLLTbdpbmw4XQ0T7LYx8I7UPBubywwoog3utUJVfmzxwEBm7ISWbOwNlQLMg38KT669ibfpwcIE Jun 27 21:22:52.844106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:22:52.844106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:22:52.844106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:22:52.844106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:22:52.844106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:22:52.844106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:22:52.844106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: fce4740b494c472dba26d969ed39a7ee Jun 27 21:22:52.844106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesNegativeTest-1106076097 Jun 27 21:22:52.844106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:22:52.844106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:22:52.845746 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fce4740b494c472dba26d969ed39a7ee", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fce4740b494c472dba26d969ed39a7ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fce4740b494c472dba26d969ed39a7ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fce4740b494c472dba26d969ed39a7ee"}]}] Jun 27 21:22:52.845746 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesNegativeTest-1106076097 Jun 27 21:22:52.845746 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: fce4740b494c472dba26d969ed39a7ee Jun 27 21:22:52.845746 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesNegativeTest-1106076097 Jun 27 21:22:52.845746 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesNegativeTest-1106076097-project Jun 27 21:22:52.845746 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:22:52.845746 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:22:52.845746 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: 6f07bcf30f81451a896d9f8f3820f3a4 Jun 27 21:22:52.845746 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesNegativeTest-1106076097-project Jun 27 21:22:52.845746 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Jun 27 21:22:52.845746 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-219053808", "metadata": {"Type": "work"}}} Jun 27 21:22:52.845746 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: Jun 27 21:22:52.845746 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 27 21:22:52.851270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-219053808', 'metadata': {'Type': 'work'}}}} Jun 27 21:22:52.851270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:52.851270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:52.851270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 27 21:22:52.851270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 27 21:22:52.851270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 27 21:22:52.851270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise error Jun 27 21:22:52.851270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 27 21:22:52.851270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.851270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 27 21:22:52.851270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 27 21:22:52.851270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.851270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 27 21:22:52.851270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi '#$%' Jun 27 21:22:52.851270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.851270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:52.851270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.851270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:52.851270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:52.851270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:52.851270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:52.851270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:52.853087 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 21:22:52.853087 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 21:22:52.853087 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:52.853087 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:52.853087 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 27 21:22:52.853087 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 27 21:22:52.853087 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 27 21:22:52.853087 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 27 21:22:52.853087 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 27 21:22:52.853087 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 27 21:22:52.853087 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 27 21:22:52.853087 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.853087 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:52.853087 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.853087 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:52.853087 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:52.853087 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:52.853087 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 27 21:22:52.853087 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 27 21:22:52.854797 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 27 21:22:52.854797 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.854797 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-000015de-67a0-401d-beb8-c550d10a64b3 tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:52.854797 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-000015de-67a0-401d-beb8-c550d10a64b3 tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.173094 Jun 27 21:22:52.854797 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 405/833] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Jun 27 21:22:52 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 27 21:22:52.859561 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4550de90-81d6-44d4-8dd4-f17084868606 tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] Action: 'create', calling method: .version_select at 0x7f834f233940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2112433266", "metadata": {"Type": "work"}}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:52.863468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4550de90-81d6-44d4-8dd4-f17084868606 tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] Request method failure captured: Jun 27 21:22:52.863468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 27 21:22:52.863468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:22:52.863468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:22:52.863468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:22:52.863468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 120 Jun 27 21:22:52.863468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:22:52.863468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:22:52.863468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:22:52.863468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:52.863468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh-s9BqHcN-rpZJkVXCPkYm9Wnxm6SP9pMdoThyvjk2OgFbRAAjh_6BJOo-_FUmRoaar8rvaBgJzaqybHbcxhGVyfcANBzfM9zLmKLLTbdpbmw4XQ0T7LYx8I7UPBubywwoog3utUJVfmzxwEBm7ISWbOwNlQLMg38KT669ibfpwcIE Jun 27 21:22:52.863468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:22:52.863468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:22:52.863468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:22:52.863468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:22:52.863468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:22:52.863468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:22:52.863468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: fce4740b494c472dba26d969ed39a7ee Jun 27 21:22:52.863468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-VolumesNegativeTest-1106076097 Jun 27 21:22:52.863468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:22:52.863468 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:22:52.865211 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fce4740b494c472dba26d969ed39a7ee", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fce4740b494c472dba26d969ed39a7ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fce4740b494c472dba26d969ed39a7ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fce4740b494c472dba26d969ed39a7ee"}]}] Jun 27 21:22:52.865211 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-VolumesNegativeTest-1106076097 Jun 27 21:22:52.865211 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: fce4740b494c472dba26d969ed39a7ee Jun 27 21:22:52.865211 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-VolumesNegativeTest-1106076097 Jun 27 21:22:52.865211 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-VolumesNegativeTest-1106076097-project Jun 27 21:22:52.865211 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:22:52.865211 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:22:52.865211 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: 6f07bcf30f81451a896d9f8f3820f3a4 Jun 27 21:22:52.865211 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-VolumesNegativeTest-1106076097-project Jun 27 21:22:52.865211 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Jun 27 21:22:52.865211 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2112433266", "metadata": {"Type": "work"}}} Jun 27 21:22:52.865211 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: Jun 27 21:22:52.865211 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 27 21:22:52.870996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2112433266', 'metadata': {'Type': 'work'}}}} Jun 27 21:22:52.870996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:52.870996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:52.870996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 27 21:22:52.870996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 27 21:22:52.870996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 27 21:22:52.870996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise error Jun 27 21:22:52.870996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 27 21:22:52.870996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.870996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 27 21:22:52.870996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 27 21:22:52.870996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.870996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 27 21:22:52.870996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi '0' Jun 27 21:22:52.870996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.870996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:52.870996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.870996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:52.870996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:52.870996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:52.870996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:52.870996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:52.872876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 21:22:52.872876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 21:22:52.872876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:52.872876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:52.872876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 27 21:22:52.872876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 27 21:22:52.872876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 27 21:22:52.872876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 27 21:22:52.872876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 27 21:22:52.872876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 27 21:22:52.872876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 27 21:22:52.872876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.872876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:52.872876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.872876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:52.872876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:52.872876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:52.872876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 27 21:22:52.872876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 27 21:22:52.874333 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 27 21:22:52.874333 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.874333 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4550de90-81d6-44d4-8dd4-f17084868606 tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:52.874333 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4550de90-81d6-44d4-8dd4-f17084868606 tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010821 Jun 27 21:22:52.874720 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1929794d-a877-4500-b114-b9706db67e5b tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:52.874820 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 429/834] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Jun 27 21:22:52 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 27 21:22:52.874919 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1929794d-a877-4500-b114-b9706db67e5b tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: b7dedf72-564d-4542-ae8e-626f445758d6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:52.875361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-aac6b6a5-1cf0-4e08-b00a-5aa489641cb1 tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] Action: 'create', calling method: .version_select at 0x7f834f1c2280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-736195565", "metadata": {"Type": "work"}}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:52.877706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-aac6b6a5-1cf0-4e08-b00a-5aa489641cb1 tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] Request method failure captured: Jun 27 21:22:52.877706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 27 21:22:52.877706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:22:52.877706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:22:52.877706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:22:52.877706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 118 Jun 27 21:22:52.877706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:22:52.877706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:22:52.877706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:22:52.877706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:52.877706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh-s9BqHcN-rpZJkVXCPkYm9Wnxm6SP9pMdoThyvjk2OgFbRAAjh_6BJOo-_FUmRoaar8rvaBgJzaqybHbcxhGVyfcANBzfM9zLmKLLTbdpbmw4XQ0T7LYx8I7UPBubywwoog3utUJVfmzxwEBm7ISWbOwNlQLMg38KT669ibfpwcIE Jun 27 21:22:52.877706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:22:52.877706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:22:52.877706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:22:52.877706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:22:52.877706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:22:52.877706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:22:52.877706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: fce4740b494c472dba26d969ed39a7ee Jun 27 21:22:52.877706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-VolumesNegativeTest-1106076097 Jun 27 21:22:52.877706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:22:52.877706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:22:52.881375 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fce4740b494c472dba26d969ed39a7ee", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fce4740b494c472dba26d969ed39a7ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fce4740b494c472dba26d969ed39a7ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fce4740b494c472dba26d969ed39a7ee"}]}] Jun 27 21:22:52.881375 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-VolumesNegativeTest-1106076097 Jun 27 21:22:52.881375 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: fce4740b494c472dba26d969ed39a7ee Jun 27 21:22:52.881375 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-VolumesNegativeTest-1106076097 Jun 27 21:22:52.881375 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-VolumesNegativeTest-1106076097-project Jun 27 21:22:52.881375 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:22:52.881375 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:22:52.881375 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: 6f07bcf30f81451a896d9f8f3820f3a4 Jun 27 21:22:52.881375 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-VolumesNegativeTest-1106076097-project Jun 27 21:22:52.881375 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Jun 27 21:22:52.881375 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-736195565", "metadata": {"Type": "work"}}} Jun 27 21:22:52.881375 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: Jun 27 21:22:52.881375 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 27 21:22:52.882216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-736195565', 'metadata': {'Type': 'work'}}}} Jun 27 21:22:52.882216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:52.882216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:52.882216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 27 21:22:52.882216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 27 21:22:52.882216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 27 21:22:52.882216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise error Jun 27 21:22:52.882216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 27 21:22:52.882216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.882216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 27 21:22:52.882216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 27 21:22:52.882216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.882216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 27 21:22:52.882216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi '' Jun 27 21:22:52.882216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.882216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:52.882216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.882216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:52.882216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:52.882216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:52.882216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:52.882216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:52.885063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 21:22:52.885063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 21:22:52.885063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:52.885063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:52.885063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 27 21:22:52.885063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 27 21:22:52.885063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 27 21:22:52.885063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 27 21:22:52.885063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 27 21:22:52.885063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 27 21:22:52.885063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 27 21:22:52.885063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.885063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:52.885063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.885063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:52.885063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:52.885063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:52.885063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 27 21:22:52.885063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 27 21:22:52.886383 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 27 21:22:52.886383 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.886549 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1929794d-a877-4500-b114-b9706db67e5b tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:52.886660 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-aac6b6a5-1cf0-4e08-b00a-5aa489641cb1 tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:52.886753 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1929794d-a877-4500-b114-b9706db67e5b tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:52.886844 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-aac6b6a5-1cf0-4e08-b00a-5aa489641cb1 tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007972 Jun 27 21:22:52.886944 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1929794d-a877-4500-b114-b9706db67e5b tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:52.887038 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 430/835] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Jun 27 21:22:52 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 27 21:22:52.887137 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1929794d-a877-4500-b114-b9706db67e5b tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:52.894900 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f8058ea4-65e5-49f2-83f3-ca62adbb54ba tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] Calling method '.version_select at 0x7f834f1c20d0>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:52.926859 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-f8058ea4-65e5-49f2-83f3-ca62adbb54ba tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] HTTP exception thrown: Volume tempest-invalid-910955069 could not be found. Jun 27 21:22:52.929486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f8058ea4-65e5-49f2-83f3-ca62adbb54ba tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] Request method failure captured: Jun 27 21:22:52.929486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-910955069 HTTP/1.1 Jun 27 21:22:52.929486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:22:52.929486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:22:52.929486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:22:52.929486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:22:52.929486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:22:52.929486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:22:52.929486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:22:52.929486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:52.929486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh-s9BqHcN-rpZJkVXCPkYm9Wnxm6SP9pMdoThyvjk2OgFbRAAjh_6BJOo-_FUmRoaar8rvaBgJzaqybHbcxhGVyfcANBzfM9zLmKLLTbdpbmw4XQ0T7LYx8I7UPBubywwoog3utUJVfmzxwEBm7ISWbOwNlQLMg38KT669ibfpwcIE Jun 27 21:22:52.929486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:22:52.929486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:22:52.929486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:22:52.929486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:22:52.929486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:22:52.929486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:22:52.929486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: fce4740b494c472dba26d969ed39a7ee Jun 27 21:22:52.929486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-VolumesNegativeTest-1106076097 Jun 27 21:22:52.929486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:22:52.929486 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:22:52.930862 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fce4740b494c472dba26d969ed39a7ee", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fce4740b494c472dba26d969ed39a7ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fce4740b494c472dba26d969ed39a7ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fce4740b494c472dba26d969ed39a7ee"}]}] Jun 27 21:22:52.930862 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-VolumesNegativeTest-1106076097 Jun 27 21:22:52.930862 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: fce4740b494c472dba26d969ed39a7ee Jun 27 21:22:52.930862 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-VolumesNegativeTest-1106076097 Jun 27 21:22:52.930862 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-VolumesNegativeTest-1106076097-project Jun 27 21:22:52.930862 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:22:52.930862 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:22:52.930862 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: 6f07bcf30f81451a896d9f8f3820f3a4 Jun 27 21:22:52.930862 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-VolumesNegativeTest-1106076097-project Jun 27 21:22:52.930862 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: Jun 27 21:22:52.930862 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Volume tempest-invalid-910955069 could not be found. Jun 27 21:22:52.930862 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'id': 'tempest-invalid-910955069'} Jun 27 21:22:52.930862 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:52.931653 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:52.931653 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:22:52.931653 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:22:52.931653 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 21:22:52.931653 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 21:22:52.931653 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 21:22:52.931653 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 21:22:52.931653 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 21:22:52.931653 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 21:22:52.931653 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 21:22:52.931653 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 21:22:52.931653 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:22:52.931653 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:22:52.931653 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:22:52.931653 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:22:52.931653 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-910955069 could not be found. (HTTP 404) (Request-ID: req-974942da-92a6-4380-97aa-dc77ed1ed101) Jun 27 21:22:52.931653 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.931653 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:52.931653 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.932866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:52.932866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 27 21:22:52.932866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 27 21:22:52.932866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 21:22:52.932866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 21:22:52.932866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 21:22:52.932866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 21:22:52.932866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 21:22:52.932866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 21:22:52.932866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:22:52.932866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:22:52.932866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 21:22:52.932866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 21:22:52.932866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 21:22:52.932866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 21:22:52.932866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 21:22:52.932866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 21:22:52.932866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 21:22:52.932866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 21:22:52.935517 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:22:52.935517 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:22:52.935517 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:22:52.935517 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:22:52.935517 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-910955069 could not be found. Jun 27 21:22:52.935517 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.935517 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:52.935517 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.935517 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:52.935517 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:52.935517 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:52.935517 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:52.935517 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:52.935517 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 21:22:52.935517 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 21:22:52.935517 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:52.935517 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:52.935517 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 27 21:22:52.935517 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:52.935517 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-910955069 could not be found. Jun 27 21:22:52.938049 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.938049 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:52.938049 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.938049 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:52.938049 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:52.938049 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:52.938049 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:52.938049 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:52.938049 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-910955069 could not be found. Jun 27 21:22:52.938049 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.938049 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f8058ea4-65e5-49f2-83f3-ca62adbb54ba tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] Returning 404 to user: Volume tempest-invalid-910955069 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:52.938049 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f8058ea4-65e5-49f2-83f3-ca62adbb54ba tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-910955069" status: 404 len: 98 microversion: 2.1 time: 0.039906 Jun 27 21:22:52.938049 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 431/836] 10.222.0.13 () {58 vars in 1214 bytes} [Mon Jun 27 21:22:52 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-910955069 => generated 98 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 27 21:22:52.942679 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-938e0a2d-1ebb-43fc-9ad7-08b6ccbcf7a6 tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004345 Jun 27 21:22:52.943187 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 432/837] 10.222.0.13 () {58 vars in 1139 bytes} [Mon Jun 27 21:22:52 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 27 21:22:52.952559 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-54ade7c1-7d87-4548-b402-7a33b04cd343 tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004174 Jun 27 21:22:52.953099 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 433/838] 10.222.0.13 () {58 vars in 1136 bytes} [Mon Jun 27 21:22:52 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 27 21:22:52.963496 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-fbbcbbbe-8791-415c-b389-2bd0ba7d87e7 tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] Calling method '.version_select at 0x7f834f233550>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:52.992607 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-fbbcbbbe-8791-415c-b389-2bd0ba7d87e7 tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] HTTP exception thrown: Volume c9c17783-bc9c-44ec-9711-073114ccc6e9 could not be found. Jun 27 21:22:52.994586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-fbbcbbbe-8791-415c-b389-2bd0ba7d87e7 tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] Request method failure captured: Jun 27 21:22:52.994586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: DELETE /compute/v2.1/os-volumes/c9c17783-bc9c-44ec-9711-073114ccc6e9 HTTP/1.1 Jun 27 21:22:52.994586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:22:52.994586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:22:52.994586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:22:52.994586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:22:52.994586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:22:52.994586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:22:52.994586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:22:52.994586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:52.994586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh-s9BqHcN-rpZJkVXCPkYm9Wnxm6SP9pMdoThyvjk2OgFbRAAjh_6BJOo-_FUmRoaar8rvaBgJzaqybHbcxhGVyfcANBzfM9zLmKLLTbdpbmw4XQ0T7LYx8I7UPBubywwoog3utUJVfmzxwEBm7ISWbOwNlQLMg38KT669ibfpwcIE Jun 27 21:22:52.994586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:22:52.994586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:22:52.994586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:22:52.994586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:22:52.994586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:22:52.994586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:22:52.994586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: fce4740b494c472dba26d969ed39a7ee Jun 27 21:22:52.994586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-VolumesNegativeTest-1106076097 Jun 27 21:22:52.994586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:22:52.994586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:22:52.995961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fce4740b494c472dba26d969ed39a7ee", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fce4740b494c472dba26d969ed39a7ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fce4740b494c472dba26d969ed39a7ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fce4740b494c472dba26d969ed39a7ee"}]}] Jun 27 21:22:52.995961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-VolumesNegativeTest-1106076097 Jun 27 21:22:52.995961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: fce4740b494c472dba26d969ed39a7ee Jun 27 21:22:52.995961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-VolumesNegativeTest-1106076097 Jun 27 21:22:52.995961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-VolumesNegativeTest-1106076097-project Jun 27 21:22:52.995961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:22:52.995961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:22:52.995961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: 6f07bcf30f81451a896d9f8f3820f3a4 Jun 27 21:22:52.995961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-VolumesNegativeTest-1106076097-project Jun 27 21:22:52.995961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: Jun 27 21:22:52.995961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Volume c9c17783-bc9c-44ec-9711-073114ccc6e9 could not be found. Jun 27 21:22:52.995961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'id': 'c9c17783-bc9c-44ec-9711-073114ccc6e9'} Jun 27 21:22:52.995961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:52.996903 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:52.996903 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:22:52.996903 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:22:52.996903 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 21:22:52.996903 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 21:22:52.996903 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 21:22:52.996903 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 21:22:52.996903 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 21:22:52.996903 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 21:22:52.996903 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 21:22:52.996903 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 21:22:52.996903 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:22:52.996903 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:22:52.996903 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:22:52.996903 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:22:52.996903 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c9c17783-bc9c-44ec-9711-073114ccc6e9 could not be found. (HTTP 404) (Request-ID: req-af2d6156-ee60-4ca5-8682-d2fe298755bc) Jun 27 21:22:52.996903 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.996903 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:52.996903 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:52.998995 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:52.998995 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 27 21:22:52.998995 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 27 21:22:52.998995 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 21:22:52.998995 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 21:22:52.998995 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 21:22:52.998995 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 21:22:52.998995 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 21:22:52.998995 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 21:22:52.998995 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:22:52.998995 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:22:52.998995 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 21:22:52.998995 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 21:22:52.998995 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 21:22:52.998995 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 21:22:52.998995 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 21:22:52.998995 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 21:22:52.998995 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 21:22:52.998995 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 21:22:53.000508 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:22:53.000508 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:22:53.000508 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:22:53.000508 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:22:53.000508 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c9c17783-bc9c-44ec-9711-073114ccc6e9 could not be found. Jun 27 21:22:53.000508 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:53.000508 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:53.000508 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:53.000508 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:53.000508 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:53.000508 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:53.000508 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:53.000508 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:53.000508 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 21:22:53.000508 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 21:22:53.000508 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:53.000508 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:53.000508 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 27 21:22:53.000508 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:53.003844 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c9c17783-bc9c-44ec-9711-073114ccc6e9 could not be found. Jun 27 21:22:53.003844 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:53.003844 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:53.003844 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:53.003844 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:53.003844 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:53.003844 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:53.003844 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:53.003844 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:53.003844 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c9c17783-bc9c-44ec-9711-073114ccc6e9 could not be found. Jun 27 21:22:53.003844 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:53.003844 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-fbbcbbbe-8791-415c-b389-2bd0ba7d87e7 tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] Returning 404 to user: Volume c9c17783-bc9c-44ec-9711-073114ccc6e9 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:53.003844 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-fbbcbbbe-8791-415c-b389-2bd0ba7d87e7 tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/c9c17783-bc9c-44ec-9711-073114ccc6e9" status: 404 len: 109 microversion: 2.1 time: 0.036456 Jun 27 21:22:53.003844 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 434/839] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 27 21:22:52 2022] DELETE /compute/v2.1/os-volumes/c9c17783-bc9c-44ec-9711-073114ccc6e9 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 21:22:53.007784 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-48474c5f-c2f7-4a65-bde8-eeb71711860f tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] Calling method '.version_select at 0x7f834f1eaf70>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:53.037435 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-48474c5f-c2f7-4a65-bde8-eeb71711860f tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] HTTP exception thrown: Volume ce767fe2-7d39-47d2-b947-84cc533d8b4c could not be found. Jun 27 21:22:53.039830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-48474c5f-c2f7-4a65-bde8-eeb71711860f tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] Request method failure captured: Jun 27 21:22:53.039830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/os-volumes/ce767fe2-7d39-47d2-b947-84cc533d8b4c HTTP/1.1 Jun 27 21:22:53.039830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:22:53.039830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:22:53.039830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:22:53.039830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:22:53.039830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:22:53.039830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:22:53.039830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:22:53.039830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:53.039830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh-s9BqHcN-rpZJkVXCPkYm9Wnxm6SP9pMdoThyvjk2OgFbRAAjh_6BJOo-_FUmRoaar8rvaBgJzaqybHbcxhGVyfcANBzfM9zLmKLLTbdpbmw4XQ0T7LYx8I7UPBubywwoog3utUJVfmzxwEBm7ISWbOwNlQLMg38KT669ibfpwcIE Jun 27 21:22:53.039830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:22:53.039830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:22:53.039830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:22:53.039830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:22:53.039830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:22:53.039830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:22:53.039830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: fce4740b494c472dba26d969ed39a7ee Jun 27 21:22:53.039830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-VolumesNegativeTest-1106076097 Jun 27 21:22:53.039830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:22:53.039830 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:22:53.041381 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fce4740b494c472dba26d969ed39a7ee", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fce4740b494c472dba26d969ed39a7ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fce4740b494c472dba26d969ed39a7ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fce4740b494c472dba26d969ed39a7ee"}]}] Jun 27 21:22:53.041381 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-VolumesNegativeTest-1106076097 Jun 27 21:22:53.041381 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: fce4740b494c472dba26d969ed39a7ee Jun 27 21:22:53.041381 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-VolumesNegativeTest-1106076097 Jun 27 21:22:53.041381 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-VolumesNegativeTest-1106076097-project Jun 27 21:22:53.041381 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:22:53.041381 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:22:53.041381 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: 6f07bcf30f81451a896d9f8f3820f3a4 Jun 27 21:22:53.041381 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-VolumesNegativeTest-1106076097-project Jun 27 21:22:53.041381 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: Jun 27 21:22:53.041381 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Volume ce767fe2-7d39-47d2-b947-84cc533d8b4c could not be found. Jun 27 21:22:53.041381 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'id': 'ce767fe2-7d39-47d2-b947-84cc533d8b4c'} Jun 27 21:22:53.041381 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:53.042208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:53.042208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:22:53.042208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:22:53.042208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 21:22:53.042208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 21:22:53.042208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 21:22:53.042208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 21:22:53.042208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 21:22:53.042208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 21:22:53.042208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 21:22:53.042208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 21:22:53.042208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:22:53.042208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:22:53.042208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:22:53.042208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:22:53.042208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ce767fe2-7d39-47d2-b947-84cc533d8b4c could not be found. (HTTP 404) (Request-ID: req-571ccd1c-db2a-4c65-bd62-32afcef253db) Jun 27 21:22:53.042208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:53.042208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:53.042208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:53.043349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:53.043349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 21:22:53.043349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 21:22:53.043349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 21:22:53.043349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 21:22:53.043349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 21:22:53.043349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 21:22:53.043349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 21:22:53.043349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 21:22:53.043349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:22:53.043349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:22:53.043349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 21:22:53.043349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 21:22:53.043349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 21:22:53.043349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 21:22:53.043349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 21:22:53.043349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 21:22:53.043349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 21:22:53.043349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 21:22:53.044456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:22:53.044456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:22:53.044456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:22:53.044456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:22:53.044456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ce767fe2-7d39-47d2-b947-84cc533d8b4c could not be found. Jun 27 21:22:53.044456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:53.044456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:53.044456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:53.044456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:53.044456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:53.044456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:53.044456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:53.044456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:53.044456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 21:22:53.044456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 21:22:53.044456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:53.044456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:53.044456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 21:22:53.044456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:53.045703 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ce767fe2-7d39-47d2-b947-84cc533d8b4c could not be found. Jun 27 21:22:53.045703 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:53.045703 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:53.045703 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:53.045703 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:53.045703 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:53.045703 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:53.045703 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:53.045703 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:53.045703 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ce767fe2-7d39-47d2-b947-84cc533d8b4c could not be found. Jun 27 21:22:53.045703 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:22:53.045703 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-48474c5f-c2f7-4a65-bde8-eeb71711860f tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] Returning 404 to user: Volume ce767fe2-7d39-47d2-b947-84cc533d8b4c could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:53.045703 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-48474c5f-c2f7-4a65-bde8-eeb71711860f tempest-VolumesNegativeTest-1106076097 tempest-VolumesNegativeTest-1106076097-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ce767fe2-7d39-47d2-b947-84cc533d8b4c" status: 404 len: 109 microversion: 2.1 time: 0.038368 Jun 27 21:22:53.045703 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 435/840] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 27 21:22:53 2022] GET /compute/v2.1/os-volumes/ce767fe2-7d39-47d2-b947-84cc533d8b4c => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:22:53.071435 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1929794d-a877-4500-b114-b9706db67e5b tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:53.080882 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1929794d-a877-4500-b114-b9706db67e5b tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6" status: 200 len: 1314 microversion: 2.1 time: 0.222267 Jun 27 21:22:53.085101 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 406/841] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:52 2022] GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:53.855916 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-bca2041b-3d40-4f00-84e7-cfcbd49c585f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:53.856614 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-bca2041b-3d40-4f00-84e7-cfcbd49c585f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:53.863494 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bca2041b-3d40-4f00-84e7-cfcbd49c585f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:53.863943 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bca2041b-3d40-4f00-84e7-cfcbd49c585f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:53.864730 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bca2041b-3d40-4f00-84e7-cfcbd49c585f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:53.865209 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bca2041b-3d40-4f00-84e7-cfcbd49c585f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:54.030869 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-bca2041b-3d40-4f00-84e7-cfcbd49c585f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:54.040488 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-bca2041b-3d40-4f00-84e7-cfcbd49c585f tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1567 microversion: 2.1 time: 0.191200 Jun 27 21:22:54.041219 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 436/842] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:53 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:54.100443 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3276b34a-de10-4c88-b006-09b42f82c437 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:54.102294 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3276b34a-de10-4c88-b006-09b42f82c437 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: b7dedf72-564d-4542-ae8e-626f445758d6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:54.109820 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3276b34a-de10-4c88-b006-09b42f82c437 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:54.111064 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3276b34a-de10-4c88-b006-09b42f82c437 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:54.113365 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3276b34a-de10-4c88-b006-09b42f82c437 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:54.114131 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3276b34a-de10-4c88-b006-09b42f82c437 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:54.263432 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-c149a4ba-be4e-4a57-9c31-203909aa2a9e req-8f1d3f1c-6483-42dd-b2a3-c7cfad80d21c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7dedf72-564d-4542-ae8e-626f445758d6", "name": "network-vif-plugged", "status": "completed", "tag": "cc340891-83ed-4294-b526-d713283c7b21"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:54.279572 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-c149a4ba-be4e-4a57-9c31-203909aa2a9e req-8f1d3f1c-6483-42dd-b2a3-c7cfad80d21c service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:54.280331 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-c149a4ba-be4e-4a57-9c31-203909aa2a9e req-8f1d3f1c-6483-42dd-b2a3-c7cfad80d21c service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:54.298313 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-c149a4ba-be4e-4a57-9c31-203909aa2a9e req-8f1d3f1c-6483-42dd-b2a3-c7cfad80d21c service nova] Creating event network-vif-plugged:cc340891-83ed-4294-b526-d713283c7b21 for instance b7dedf72-564d-4542-ae8e-626f445758d6 on hv-cinder-84773 Jun 27 21:22:54.304107 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-c149a4ba-be4e-4a57-9c31-203909aa2a9e req-8f1d3f1c-6483-42dd-b2a3-c7cfad80d21c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045541 Jun 27 21:22:54.305086 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 437/843] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:22:54.378382 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3276b34a-de10-4c88-b006-09b42f82c437 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:54.389263 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3276b34a-de10-4c88-b006-09b42f82c437 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6" status: 200 len: 1314 microversion: 2.1 time: 0.293813 Jun 27 21:22:54.390037 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 407/844] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:54 2022] GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:22:55.076709 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b7f9e402-ae05-4ba9-9d29-6c884eb866a6 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:55.078164 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b7f9e402-ae05-4ba9-9d29-6c884eb866a6 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:55.088005 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b7f9e402-ae05-4ba9-9d29-6c884eb866a6 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:55.088665 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b7f9e402-ae05-4ba9-9d29-6c884eb866a6 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:55.089951 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b7f9e402-ae05-4ba9-9d29-6c884eb866a6 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:55.090403 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b7f9e402-ae05-4ba9-9d29-6c884eb866a6 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:55.293556 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b7f9e402-ae05-4ba9-9d29-6c884eb866a6 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:55.305679 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b7f9e402-ae05-4ba9-9d29-6c884eb866a6 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1567 microversion: 2.1 time: 0.246252 Jun 27 21:22:55.306262 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 438/845] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:55 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:55.407112 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-748d75b9-d2b8-4018-aaab-045e47566f87 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:55.407837 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-748d75b9-d2b8-4018-aaab-045e47566f87 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: b7dedf72-564d-4542-ae8e-626f445758d6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:55.415418 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-748d75b9-d2b8-4018-aaab-045e47566f87 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:55.416327 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-748d75b9-d2b8-4018-aaab-045e47566f87 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:55.417873 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-748d75b9-d2b8-4018-aaab-045e47566f87 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:55.417873 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-748d75b9-d2b8-4018-aaab-045e47566f87 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:55.731818 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-748d75b9-d2b8-4018-aaab-045e47566f87 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:55.743926 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-748d75b9-d2b8-4018-aaab-045e47566f87 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6" status: 200 len: 1314 microversion: 2.1 time: 0.340550 Jun 27 21:22:55.745172 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 408/846] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:55 2022] GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:55.928320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-ed86d133-65b5-4c62-a09a-8aa9a5002e81 req-39b6310a-512d-40a5-a793-dd31e2b7259d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9323a6ac-3a15-471a-b676-eb3e809a8637", "name": "network-vif-deleted", "tag": "36112ae1-bee5-4df6-9469-82c6af7bb1f4"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:55.942183 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-ed86d133-65b5-4c62-a09a-8aa9a5002e81 req-39b6310a-512d-40a5-a793-dd31e2b7259d service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:55.942343 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-ed86d133-65b5-4c62-a09a-8aa9a5002e81 req-39b6310a-512d-40a5-a793-dd31e2b7259d service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:55.965931 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-ed86d133-65b5-4c62-a09a-8aa9a5002e81 req-39b6310a-512d-40a5-a793-dd31e2b7259d service nova] Creating event network-vif-deleted:36112ae1-bee5-4df6-9469-82c6af7bb1f4 for instance 9323a6ac-3a15-471a-b676-eb3e809a8637 on hv-cinder-84773 Jun 27 21:22:55.971827 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-ed86d133-65b5-4c62-a09a-8aa9a5002e81 req-39b6310a-512d-40a5-a793-dd31e2b7259d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047554 Jun 27 21:22:55.976474 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 439/847] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:22:56.335969 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-524ffd41-801b-430b-b0df-946377d05e84 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:56.336614 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-524ffd41-801b-430b-b0df-946377d05e84 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:56.343583 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-524ffd41-801b-430b-b0df-946377d05e84 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:56.344257 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-524ffd41-801b-430b-b0df-946377d05e84 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:56.345516 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-524ffd41-801b-430b-b0df-946377d05e84 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:56.346124 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-524ffd41-801b-430b-b0df-946377d05e84 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:56.427825 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-524ffd41-801b-430b-b0df-946377d05e84 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:56.435844 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-524ffd41-801b-430b-b0df-946377d05e84 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1220 microversion: 2.1 time: 0.105028 Jun 27 21:22:56.436422 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 409/848] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:56 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:56.760207 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:56.761447 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=6 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:56.766331 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c008c1b4-e744-410a-be30-9d648ff2be21 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:56.767390 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c008c1b4-e744-410a-be30-9d648ff2be21 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: b7dedf72-564d-4542-ae8e-626f445758d6] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:56.776450 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c008c1b4-e744-410a-be30-9d648ff2be21 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:56.777039 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c008c1b4-e744-410a-be30-9d648ff2be21 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:56.777940 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c008c1b4-e744-410a-be30-9d648ff2be21 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:56.778514 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c008c1b4-e744-410a-be30-9d648ff2be21 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:56.931385 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c008c1b4-e744-410a-be30-9d648ff2be21 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:56.940665 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c008c1b4-e744-410a-be30-9d648ff2be21 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6" status: 200 len: 1314 microversion: 2.1 time: 0.181858 Jun 27 21:22:56.941335 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 440/849] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:56 2022] GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:57.452633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1e8163e8-0423-4c96-9310-9c156ca694be tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:57.453270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1e8163e8-0423-4c96-9310-9c156ca694be tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:57.455696 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:57.465292 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1e8163e8-0423-4c96-9310-9c156ca694be tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:57.466040 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1e8163e8-0423-4c96-9310-9c156ca694be tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:57.467191 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1e8163e8-0423-4c96-9310-9c156ca694be tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:57.467988 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1e8163e8-0423-4c96-9310-9c156ca694be tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:57.511080 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1e8163e8-0423-4c96-9310-9c156ca694be tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:57.511525 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1e8163e8-0423-4c96-9310-9c156ca694be tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:57.511969 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-1e8163e8-0423-4c96-9310-9c156ca694be tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lazy-loading 'fault' on Instance uuid 9323a6ac-3a15-471a-b676-eb3e809a8637 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:22:57.558949 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1e8163e8-0423-4c96-9310-9c156ca694be tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:57.572865 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1e8163e8-0423-4c96-9310-9c156ca694be tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1225 microversion: 2.1 time: 0.119384 Jun 27 21:22:57.572865 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 410/850] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:57 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1225 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:57.959423 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-104188d8-d52a-4128-8bc3-976fe12f40e2 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:57.960040 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-104188d8-d52a-4128-8bc3-976fe12f40e2 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: b7dedf72-564d-4542-ae8e-626f445758d6] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:57.967248 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-104188d8-d52a-4128-8bc3-976fe12f40e2 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:57.967732 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-104188d8-d52a-4128-8bc3-976fe12f40e2 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:57.968464 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-104188d8-d52a-4128-8bc3-976fe12f40e2 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:57.968955 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-104188d8-d52a-4128-8bc3-976fe12f40e2 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:58.110576 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-104188d8-d52a-4128-8bc3-976fe12f40e2 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:58.118899 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-104188d8-d52a-4128-8bc3-976fe12f40e2 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6" status: 200 len: 1499 microversion: 2.1 time: 0.163743 Jun 27 21:22:58.119462 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 441/851] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:57 2022] GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6 => generated 1499 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:58.586511 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cc9f2701-bdf5-4642-9e4e-2a0c1d4dba47 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:58.587183 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cc9f2701-bdf5-4642-9e4e-2a0c1d4dba47 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:58.595873 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cc9f2701-bdf5-4642-9e4e-2a0c1d4dba47 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:58.596528 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cc9f2701-bdf5-4642-9e4e-2a0c1d4dba47 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:58.597724 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cc9f2701-bdf5-4642-9e4e-2a0c1d4dba47 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:58.598372 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cc9f2701-bdf5-4642-9e4e-2a0c1d4dba47 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:58.639043 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cc9f2701-bdf5-4642-9e4e-2a0c1d4dba47 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:58.639490 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cc9f2701-bdf5-4642-9e4e-2a0c1d4dba47 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:58.639971 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-cc9f2701-bdf5-4642-9e4e-2a0c1d4dba47 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lazy-loading 'fault' on Instance uuid 9323a6ac-3a15-471a-b676-eb3e809a8637 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:22:58.684989 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cc9f2701-bdf5-4642-9e4e-2a0c1d4dba47 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:58.693063 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cc9f2701-bdf5-4642-9e4e-2a0c1d4dba47 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1225 microversion: 2.1 time: 0.111171 Jun 27 21:22:58.693617 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 411/852] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:58 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:59.714701 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7c738eeb-6b4b-41ad-b803-f3fe73fb4f52 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:59.715361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7c738eeb-6b4b-41ad-b803-f3fe73fb4f52 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:59.723822 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7c738eeb-6b4b-41ad-b803-f3fe73fb4f52 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:59.724274 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7c738eeb-6b4b-41ad-b803-f3fe73fb4f52 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:59.725319 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7c738eeb-6b4b-41ad-b803-f3fe73fb4f52 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:59.725587 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7c738eeb-6b4b-41ad-b803-f3fe73fb4f52 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:59.771504 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7c738eeb-6b4b-41ad-b803-f3fe73fb4f52 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:59.771950 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7c738eeb-6b4b-41ad-b803-f3fe73fb4f52 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:59.772463 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-7c738eeb-6b4b-41ad-b803-f3fe73fb4f52 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lazy-loading 'fault' on Instance uuid 9323a6ac-3a15-471a-b676-eb3e809a8637 {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:22:59.818809 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7c738eeb-6b4b-41ad-b803-f3fe73fb4f52 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8428365f1148a2934dd4596deeb43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f484976e63ce44daa10eadd2a9d6cc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:59.826503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7c738eeb-6b4b-41ad-b803-f3fe73fb4f52 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 200 len: 1179 microversion: 2.1 time: 0.120170 Jun 27 21:22:59.826998 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 442/853] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:59 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 1179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:00.843427 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c554ab33-f4b0-44b2-8a99-839721453bf9 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:00.844175 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c554ab33-f4b0-44b2-8a99-839721453bf9 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] [instance: 9323a6ac-3a15-471a-b676-eb3e809a8637] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:00.850931 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c554ab33-f4b0-44b2-8a99-839721453bf9 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:00.851731 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c554ab33-f4b0-44b2-8a99-839721453bf9 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:00.852765 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c554ab33-f4b0-44b2-8a99-839721453bf9 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:00.853495 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c554ab33-f4b0-44b2-8a99-839721453bf9 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:00.869539 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-c554ab33-f4b0-44b2-8a99-839721453bf9 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] HTTP exception thrown: Instance 9323a6ac-3a15-471a-b676-eb3e809a8637 could not be found. Jun 27 21:23:00.875007 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1ae4cba1-5604-40b3-b954-4d2f164821a4 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:00.875893 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1ae4cba1-5604-40b3-b954-4d2f164821a4 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: b7dedf72-564d-4542-ae8e-626f445758d6] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:00.881358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c554ab33-f4b0-44b2-8a99-839721453bf9 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Request method failure captured: Jun 27 21:23:00.881358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 HTTP/1.1 Jun 27 21:23:00.881358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:23:00.881358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:23:00.881358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:23:00.881358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:23:00.881358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:23:00.881358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:23:00.881358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:23:00.881358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:23:00.881358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh50BX0ZhmunT3bmN2gJRVqZ1Uuj5vAhmVgKaIwhXQdi1EyRYKXzdCxcyfFbj2gD_iC1HCIav8-3tp1xTcGLxDkPChraPC4EjgHSq-ak3jUCptB1E5iFhu7m2OGY1yntZxlWSOZ9sFeGFAhb4rPvousxc2ZjLHCZHbFOwL7FHEKzBqE Jun 27 21:23:00.881358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:23:00.881358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:23:00.881358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:23:00.881358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:23:00.881358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:23:00.881358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:23:00.881358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: f484976e63ce44daa10eadd2a9d6cc76 Jun 27 21:23:00.881358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-TestShelveInstance-762994668 Jun 27 21:23:00.881358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:23:00.881358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:23:00.883429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f484976e63ce44daa10eadd2a9d6cc76", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f484976e63ce44daa10eadd2a9d6cc76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f484976e63ce44daa10eadd2a9d6cc76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f484976e63ce44daa10eadd2a9d6cc76"}]}] Jun 27 21:23:00.883429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-TestShelveInstance-762994668 Jun 27 21:23:00.883429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: f484976e63ce44daa10eadd2a9d6cc76 Jun 27 21:23:00.883429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-TestShelveInstance-762994668 Jun 27 21:23:00.883429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-TestShelveInstance-762994668-project Jun 27 21:23:00.883429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:23:00.883429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:23:00.883429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: 4e8428365f1148a2934dd4596deeb43a Jun 27 21:23:00.883429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-TestShelveInstance-762994668-project Jun 27 21:23:00.883429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:23:00.883429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance 9323a6ac-3a15-471a-b676-eb3e809a8637 could not be found. Jun 27 21:23:00.883429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '9323a6ac-3a15-471a-b676-eb3e809a8637'} Jun 27 21:23:00.884425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:23:00.884425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:00.884425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:23:00.884425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:23:00.884425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:23:00.884425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:23:00.884425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:23:00.884425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:23:00.884425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:23:00.884425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:23:00.884425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9323a6ac-3a15-471a-b676-eb3e809a8637 could not be found. Jun 27 21:23:00.884425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:23:00.884425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:23:00.884425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:23:00.884425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:00.884425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:23:00.884425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:23:00.884425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:23:00.884425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:23:00.884425 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:23:00.886525 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:23:00.886525 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:23:00.886525 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:23:00.886525 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:23:00.886525 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:23:00.886525 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:23:00.886525 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:23:00.886525 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9323a6ac-3a15-471a-b676-eb3e809a8637 could not be found. Jun 27 21:23:00.886525 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:23:00.886525 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:23:00.886525 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:23:00.886525 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:00.886525 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:23:00.886525 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:23:00.886525 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:23:00.886525 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:23:00.886525 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9323a6ac-3a15-471a-b676-eb3e809a8637 could not be found. Jun 27 21:23:00.886525 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:23:00.888789 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c554ab33-f4b0-44b2-8a99-839721453bf9 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Returning 404 to user: Instance 9323a6ac-3a15-471a-b676-eb3e809a8637 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:23:00.888789 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c554ab33-f4b0-44b2-8a99-839721453bf9 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637" status: 404 len: 111 microversion: 2.1 time: 0.043415 Jun 27 21:23:00.888789 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 412/854] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:00 2022] GET /compute/v2.1/servers/9323a6ac-3a15-471a-b676-eb3e809a8637 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:23:00.889974 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1ae4cba1-5604-40b3-b954-4d2f164821a4 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:00.889974 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1ae4cba1-5604-40b3-b954-4d2f164821a4 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:00.889974 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1ae4cba1-5604-40b3-b954-4d2f164821a4 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:00.889974 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1ae4cba1-5604-40b3-b954-4d2f164821a4 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:00.892034 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=96 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:23:00.918481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1ae4cba1-5604-40b3-b954-4d2f164821a4 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: b7dedf72-564d-4542-ae8e-626f445758d6] Going to try to terminate instance {{(pid=117891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:23:01.022083 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1ae4cba1-5604-40b3-b954-4d2f164821a4 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6" status: 204 len: 0 microversion: 2.1 time: 0.150572 Jun 27 21:23:01.023052 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 443/855] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:23:00 2022] DELETE /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:23:01.031705 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c66449ed-0bce-4367-903a-df055dffb1b9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:01.032432 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c66449ed-0bce-4367-903a-df055dffb1b9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: b7dedf72-564d-4542-ae8e-626f445758d6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:01.041971 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c66449ed-0bce-4367-903a-df055dffb1b9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:01.042423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c66449ed-0bce-4367-903a-df055dffb1b9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:01.043206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c66449ed-0bce-4367-903a-df055dffb1b9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:01.043833 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c66449ed-0bce-4367-903a-df055dffb1b9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:01.103872 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0732d764-2ebf-48dd-b08b-b49a35210902 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] Calling method '.version_select at 0x7f834f2565e0>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:01.122458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0732d764-2ebf-48dd-b08b-b49a35210902 tempest-TestShelveInstance-762994668 tempest-TestShelveInstance-762994668-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1869209914" status: 202 len: 0 microversion: 2.1 time: 0.023119 Jun 27 21:23:01.123467 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 444/856] 10.222.0.13 () {58 vars in 1253 bytes} [Mon Jun 27 21:23:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1869209914 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:23:01.222397 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c66449ed-0bce-4367-903a-df055dffb1b9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:01.230441 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c66449ed-0bce-4367-903a-df055dffb1b9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6" status: 200 len: 1505 microversion: 2.1 time: 0.202539 Jun 27 21:23:01.231024 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 413/857] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:01 2022] GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6 => generated 1505 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:02.250157 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d824458f-ff31-4f95-a48c-7b25a79a881e tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:02.251099 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d824458f-ff31-4f95-a48c-7b25a79a881e tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: b7dedf72-564d-4542-ae8e-626f445758d6] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:02.259216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d824458f-ff31-4f95-a48c-7b25a79a881e tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:02.259669 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d824458f-ff31-4f95-a48c-7b25a79a881e tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:02.260451 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d824458f-ff31-4f95-a48c-7b25a79a881e tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:02.260886 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d824458f-ff31-4f95-a48c-7b25a79a881e tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:02.493223 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d824458f-ff31-4f95-a48c-7b25a79a881e tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:02.502834 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d824458f-ff31-4f95-a48c-7b25a79a881e tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6" status: 200 len: 1505 microversion: 2.1 time: 0.257596 Jun 27 21:23:02.514206 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 445/858] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:02 2022] GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6 => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:03.521230 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-562a901d-dab1-4a19-8c7b-bb37f6ccb00f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:03.521906 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-562a901d-dab1-4a19-8c7b-bb37f6ccb00f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: b7dedf72-564d-4542-ae8e-626f445758d6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:03.529190 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-562a901d-dab1-4a19-8c7b-bb37f6ccb00f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:03.529565 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-562a901d-dab1-4a19-8c7b-bb37f6ccb00f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:03.530334 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-562a901d-dab1-4a19-8c7b-bb37f6ccb00f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:03.530799 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-562a901d-dab1-4a19-8c7b-bb37f6ccb00f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:03.722230 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-562a901d-dab1-4a19-8c7b-bb37f6ccb00f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:03.731168 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-562a901d-dab1-4a19-8c7b-bb37f6ccb00f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6" status: 200 len: 1505 microversion: 2.1 time: 0.213836 Jun 27 21:23:03.740678 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 414/859] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:03 2022] GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6 => generated 1505 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:04.748001 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-39d13a33-0266-48b2-8a00-1ce7019bf969 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:04.748652 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-39d13a33-0266-48b2-8a00-1ce7019bf969 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: b7dedf72-564d-4542-ae8e-626f445758d6] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:04.755828 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-39d13a33-0266-48b2-8a00-1ce7019bf969 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:04.756277 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-39d13a33-0266-48b2-8a00-1ce7019bf969 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:04.757164 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-39d13a33-0266-48b2-8a00-1ce7019bf969 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:04.757598 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-39d13a33-0266-48b2-8a00-1ce7019bf969 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:04.906772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-39d13a33-0266-48b2-8a00-1ce7019bf969 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:04.916448 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-39d13a33-0266-48b2-8a00-1ce7019bf969 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6" status: 200 len: 1505 microversion: 2.1 time: 0.171907 Jun 27 21:23:04.917247 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 446/860] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:04 2022] GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6 => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:05.934540 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ba60100b-3bc4-467f-8daa-ef7da7e77dab tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:05.935588 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ba60100b-3bc4-467f-8daa-ef7da7e77dab tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: b7dedf72-564d-4542-ae8e-626f445758d6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:05.942665 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ba60100b-3bc4-467f-8daa-ef7da7e77dab tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:05.943107 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ba60100b-3bc4-467f-8daa-ef7da7e77dab tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:05.943884 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ba60100b-3bc4-467f-8daa-ef7da7e77dab tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:05.944628 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ba60100b-3bc4-467f-8daa-ef7da7e77dab tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:05.980545 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-137cd018-65b9-49b7-9047-4e5d5619ab67 req-7a94cc12-0880-43bd-9274-878da48796e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7dedf72-564d-4542-ae8e-626f445758d6", "name": "network-vif-deleted", "tag": "cc340891-83ed-4294-b526-d713283c7b21"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:23:05.986515 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:23:05.992029 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-137cd018-65b9-49b7-9047-4e5d5619ab67 req-7a94cc12-0880-43bd-9274-878da48796e6 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:05.992503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-137cd018-65b9-49b7-9047-4e5d5619ab67 req-7a94cc12-0880-43bd-9274-878da48796e6 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:06.007899 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-137cd018-65b9-49b7-9047-4e5d5619ab67 req-7a94cc12-0880-43bd-9274-878da48796e6 service nova] Creating event network-vif-deleted:cc340891-83ed-4294-b526-d713283c7b21 for instance b7dedf72-564d-4542-ae8e-626f445758d6 on hv-cinder-84773 Jun 27 21:23:06.016261 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-137cd018-65b9-49b7-9047-4e5d5619ab67 req-7a94cc12-0880-43bd-9274-878da48796e6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039403 Jun 27 21:23:06.017483 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 447/861] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:23:06.035405 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ba60100b-3bc4-467f-8daa-ef7da7e77dab tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:06.043635 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ba60100b-3bc4-467f-8daa-ef7da7e77dab tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6" status: 200 len: 1463 microversion: 2.1 time: 0.113866 Jun 27 21:23:06.044225 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 415/862] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:05 2022] GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6 => generated 1463 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:07.061800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ff882c7b-4109-4655-8588-caaf01dceee2 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:07.062460 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ff882c7b-4109-4655-8588-caaf01dceee2 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: b7dedf72-564d-4542-ae8e-626f445758d6] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:07.069657 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ff882c7b-4109-4655-8588-caaf01dceee2 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:07.070356 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ff882c7b-4109-4655-8588-caaf01dceee2 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:07.071354 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ff882c7b-4109-4655-8588-caaf01dceee2 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:07.071836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ff882c7b-4109-4655-8588-caaf01dceee2 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:07.139592 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ff882c7b-4109-4655-8588-caaf01dceee2 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:07.147966 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ff882c7b-4109-4655-8588-caaf01dceee2 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6" status: 200 len: 1463 microversion: 2.1 time: 0.091575 Jun 27 21:23:07.148763 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 448/863] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:07 2022] GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6 => generated 1463 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:08.166150 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2286383b-72ee-4a39-ae7e-5628d4aff4d5 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:08.166739 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2286383b-72ee-4a39-ae7e-5628d4aff4d5 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: b7dedf72-564d-4542-ae8e-626f445758d6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:08.174707 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2286383b-72ee-4a39-ae7e-5628d4aff4d5 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:08.175270 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2286383b-72ee-4a39-ae7e-5628d4aff4d5 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:08.176314 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2286383b-72ee-4a39-ae7e-5628d4aff4d5 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:08.176794 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2286383b-72ee-4a39-ae7e-5628d4aff4d5 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:08.283199 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2286383b-72ee-4a39-ae7e-5628d4aff4d5 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:08.295126 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2286383b-72ee-4a39-ae7e-5628d4aff4d5 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6" status: 200 len: 1299 microversion: 2.1 time: 0.133801 Jun 27 21:23:08.295642 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 416/864] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:08 2022] GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6 => generated 1299 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:09.312399 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f24d5809-c89f-41b5-a9ae-139592dd0d1a tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:09.313451 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f24d5809-c89f-41b5-a9ae-139592dd0d1a tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: b7dedf72-564d-4542-ae8e-626f445758d6] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:09.325418 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f24d5809-c89f-41b5-a9ae-139592dd0d1a tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:09.330179 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f24d5809-c89f-41b5-a9ae-139592dd0d1a tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:09.331231 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f24d5809-c89f-41b5-a9ae-139592dd0d1a tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:09.332135 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f24d5809-c89f-41b5-a9ae-139592dd0d1a tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:09.349047 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-f24d5809-c89f-41b5-a9ae-139592dd0d1a tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] HTTP exception thrown: Instance b7dedf72-564d-4542-ae8e-626f445758d6 could not be found. Jun 27 21:23:09.350603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f24d5809-c89f-41b5-a9ae-139592dd0d1a tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Request method failure captured: Jun 27 21:23:09.350603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6 HTTP/1.1 Jun 27 21:23:09.350603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:23:09.350603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:23:09.350603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:23:09.350603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:23:09.350603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:23:09.350603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:23:09.350603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:23:09.350603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:23:09.350603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh-kMVtNWGmprU8r6fIdc3nAoJ453mFQEUYKBwARi_Mnzol5MxGzSt452oBKqgo3bU4Rm0mxwm-FnYwXCL_SiKJ04RfjvS8QDbWNG9KI0yTcdxpYUk89QfnBS86Q7FkcB4RWK1-PJog0yanIRziJZ_xtoAhfxtRY6v6CzjZQ6zJvL8E Jun 27 21:23:09.350603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:23:09.350603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:23:09.350603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:23:09.350603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:23:09.350603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:23:09.350603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:23:09.350603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: 8b70340671074b2aa4c80384cb6f1c85 Jun 27 21:23:09.350603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-VolumesActionsTest-2053792718 Jun 27 21:23:09.350603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:23:09.350603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:23:09.352430 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8b70340671074b2aa4c80384cb6f1c85", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8b70340671074b2aa4c80384cb6f1c85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8b70340671074b2aa4c80384cb6f1c85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8b70340671074b2aa4c80384cb6f1c85"}]}] Jun 27 21:23:09.352430 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-VolumesActionsTest-2053792718 Jun 27 21:23:09.352430 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 8b70340671074b2aa4c80384cb6f1c85 Jun 27 21:23:09.352430 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-VolumesActionsTest-2053792718 Jun 27 21:23:09.352430 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-VolumesActionsTest-2053792718-project Jun 27 21:23:09.352430 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:23:09.352430 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:23:09.352430 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: e0e171895ccc4f1cbc69ead21175fc5d Jun 27 21:23:09.352430 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-VolumesActionsTest-2053792718-project Jun 27 21:23:09.352430 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: > Jun 27 21:23:09.352430 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Instance b7dedf72-564d-4542-ae8e-626f445758d6 could not be found. Jun 27 21:23:09.352430 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'id': 'b7dedf72-564d-4542-ae8e-626f445758d6'} Jun 27 21:23:09.354322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:23:09.354322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:09.354322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:23:09.354322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:23:09.354322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:23:09.354322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:23:09.354322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:23:09.354322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:23:09.354322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:23:09.354322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:23:09.354322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7dedf72-564d-4542-ae8e-626f445758d6 could not be found. Jun 27 21:23:09.354322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:23:09.354322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:23:09.354322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:23:09.354322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:09.354322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:23:09.354322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:23:09.354322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:23:09.354322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:23:09.354322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:23:09.356322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:23:09.356322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:23:09.356322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:23:09.356322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:23:09.356322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:23:09.356322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:23:09.356322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:23:09.356322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7dedf72-564d-4542-ae8e-626f445758d6 could not be found. Jun 27 21:23:09.356322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:23:09.356322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:23:09.356322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:23:09.356322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:09.356322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:23:09.356322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:23:09.356322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:23:09.356322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:23:09.356322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7dedf72-564d-4542-ae8e-626f445758d6 could not be found. Jun 27 21:23:09.356322 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:23:09.357632 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f24d5809-c89f-41b5-a9ae-139592dd0d1a tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Returning 404 to user: Instance b7dedf72-564d-4542-ae8e-626f445758d6 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:23:09.357632 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f24d5809-c89f-41b5-a9ae-139592dd0d1a tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6" status: 404 len: 111 microversion: 2.1 time: 0.044207 Jun 27 21:23:09.357632 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 449/865] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:09 2022] GET /compute/v2.1/servers/b7dedf72-564d-4542-ae8e-626f445758d6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:23:09.484938 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b4b5d0ea-914f-44a8-a672-6fe56e87adcb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2104674803", "imageRef": "3155f228-b1ff-487e-837f-85eec68c250a", "flavorRef": "452", "networks": [{"uuid": "d80fed7e-ca08-478c-bcce-00fe66ce3ab4"}]}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:23:09.559570 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-b4b5d0ea-914f-44a8-a672-6fe56e87adcb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] validate_networks() for [('d80fed7e-ca08-478c-bcce-00fe66ce3ab4', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:23:09.951056 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-b4b5d0ea-914f-44a8-a672-6fe56e87adcb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:23:09.951476 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-b4b5d0ea-914f-44a8-a672-6fe56e87adcb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:23:09.952023 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-b4b5d0ea-914f-44a8-a672-6fe56e87adcb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:23:09.952457 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-b4b5d0ea-914f-44a8-a672-6fe56e87adcb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:23:09.952840 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-b4b5d0ea-914f-44a8-a672-6fe56e87adcb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:23:09.963346 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b4b5d0ea-914f-44a8-a672-6fe56e87adcb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:09.963838 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b4b5d0ea-914f-44a8-a672-6fe56e87adcb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:09.964650 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b4b5d0ea-914f-44a8-a672-6fe56e87adcb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:09.965104 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b4b5d0ea-914f-44a8-a672-6fe56e87adcb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:09.983101 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-b4b5d0ea-914f-44a8-a672-6fe56e87adcb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Getting quotas for project 8b70340671074b2aa4c80384cb6f1c85. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:23:09.987147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-b4b5d0ea-914f-44a8-a672-6fe56e87adcb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Getting quotas for user e0e171895ccc4f1cbc69ead21175fc5d and project 8b70340671074b2aa4c80384cb6f1c85. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:23:09.999614 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b4b5d0ea-914f-44a8-a672-6fe56e87adcb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:23:10.002606 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b4b5d0ea-914f-44a8-a672-6fe56e87adcb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3155f228-b1ff-487e-837f-85eec68c250a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:23:10.051066 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b4b5d0ea-914f-44a8-a672-6fe56e87adcb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572178 Jun 27 21:23:10.051719 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 417/866] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 27 21:23:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:23:10.062159 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9f36cb70-1f85-4d1c-ae60-249fd160e409 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:10.062758 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9f36cb70-1f85-4d1c-ae60-249fd160e409 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:10.125347 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9f36cb70-1f85-4d1c-ae60-249fd160e409 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:10.133285 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9f36cb70-1f85-4d1c-ae60-249fd160e409 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4" status: 200 len: 1214 microversion: 2.1 time: 0.074986 Jun 27 21:23:10.133857 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 450/867] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:10 2022] GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:11.151881 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ec6ccb6a-0723-4053-ad95-4c387d4a89ee tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:11.152618 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ec6ccb6a-0723-4053-ad95-4c387d4a89ee tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:11.159621 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ec6ccb6a-0723-4053-ad95-4c387d4a89ee tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:11.160287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ec6ccb6a-0723-4053-ad95-4c387d4a89ee tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:11.161415 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ec6ccb6a-0723-4053-ad95-4c387d4a89ee tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:11.162151 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ec6ccb6a-0723-4053-ad95-4c387d4a89ee tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:11.246111 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ec6ccb6a-0723-4053-ad95-4c387d4a89ee tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:11.254984 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ec6ccb6a-0723-4053-ad95-4c387d4a89ee tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4" status: 200 len: 1284 microversion: 2.1 time: 0.108332 Jun 27 21:23:11.255822 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 418/868] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:11 2022] GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 => generated 1284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:12.275792 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-43411efe-8c3f-4a89-b552-25d382013c67 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:12.276525 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-43411efe-8c3f-4a89-b552-25d382013c67 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:12.285752 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-43411efe-8c3f-4a89-b552-25d382013c67 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:12.286339 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-43411efe-8c3f-4a89-b552-25d382013c67 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:12.287119 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-43411efe-8c3f-4a89-b552-25d382013c67 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:12.287527 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-43411efe-8c3f-4a89-b552-25d382013c67 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:12.436774 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-43411efe-8c3f-4a89-b552-25d382013c67 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:12.445311 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-43411efe-8c3f-4a89-b552-25d382013c67 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4" status: 200 len: 1314 microversion: 2.1 time: 0.175582 Jun 27 21:23:12.445902 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 451/869] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:12 2022] GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:12.508149 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-036cd136-7228-4598-beeb-0d34b3cce888 req-e025a3e3-8fa8-41f1-ba8a-b0ba6d915bfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4", "tag": "5e9dc96f-1bf7-4645-a8e5-8a7436dd3593"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:23:12.526010 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-036cd136-7228-4598-beeb-0d34b3cce888 req-e025a3e3-8fa8-41f1-ba8a-b0ba6d915bfb service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:12.526502 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-036cd136-7228-4598-beeb-0d34b3cce888 req-e025a3e3-8fa8-41f1-ba8a-b0ba6d915bfb service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:12.542137 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-036cd136-7228-4598-beeb-0d34b3cce888 req-e025a3e3-8fa8-41f1-ba8a-b0ba6d915bfb service nova] Creating event network-changed:5e9dc96f-1bf7-4645-a8e5-8a7436dd3593 for instance d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 on hv-cinder-84773 Jun 27 21:23:12.549850 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-036cd136-7228-4598-beeb-0d34b3cce888 req-e025a3e3-8fa8-41f1-ba8a-b0ba6d915bfb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044685 Jun 27 21:23:12.550874 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 419/870] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:23:13.465057 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-fa661982-2dde-48d3-bca3-b1373d001584 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:13.466311 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-fa661982-2dde-48d3-bca3-b1373d001584 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:13.475383 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fa661982-2dde-48d3-bca3-b1373d001584 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:13.476564 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fa661982-2dde-48d3-bca3-b1373d001584 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:13.477595 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fa661982-2dde-48d3-bca3-b1373d001584 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:13.478164 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fa661982-2dde-48d3-bca3-b1373d001584 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:13.627459 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-fa661982-2dde-48d3-bca3-b1373d001584 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:13.635467 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-fa661982-2dde-48d3-bca3-b1373d001584 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4" status: 200 len: 1314 microversion: 2.1 time: 0.175517 Jun 27 21:23:13.636065 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 452/871] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:13 2022] GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:14.652974 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-18e30cc1-5c35-4c80-b534-a0d1813c5e92 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:14.654388 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-18e30cc1-5c35-4c80-b534-a0d1813c5e92 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:14.661709 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18e30cc1-5c35-4c80-b534-a0d1813c5e92 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:14.662462 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18e30cc1-5c35-4c80-b534-a0d1813c5e92 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:14.663453 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18e30cc1-5c35-4c80-b534-a0d1813c5e92 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:14.664053 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18e30cc1-5c35-4c80-b534-a0d1813c5e92 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:14.681753 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:23:15.026986 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-18e30cc1-5c35-4c80-b534-a0d1813c5e92 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:15.035358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-18e30cc1-5c35-4c80-b534-a0d1813c5e92 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4" status: 200 len: 1314 microversion: 2.1 time: 0.387100 Jun 27 21:23:15.036373 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 420/872] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:14 2022] GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:16.053105 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3cd66fe9-314c-4e6b-ae09-09624d61d3a8 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:16.053971 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3cd66fe9-314c-4e6b-ae09-09624d61d3a8 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:16.060425 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3cd66fe9-314c-4e6b-ae09-09624d61d3a8 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:16.060872 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3cd66fe9-314c-4e6b-ae09-09624d61d3a8 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:16.061715 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3cd66fe9-314c-4e6b-ae09-09624d61d3a8 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:16.062088 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3cd66fe9-314c-4e6b-ae09-09624d61d3a8 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:16.527782 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3cd66fe9-314c-4e6b-ae09-09624d61d3a8 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:16.536073 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3cd66fe9-314c-4e6b-ae09-09624d61d3a8 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4" status: 200 len: 1314 microversion: 2.1 time: 0.486720 Jun 27 21:23:16.536741 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 453/873] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:16 2022] GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:23:17.559445 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0fce7c74-e4e6-4de7-8254-7c9b98e6e18d tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:17.560231 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0fce7c74-e4e6-4de7-8254-7c9b98e6e18d tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:17.567136 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0fce7c74-e4e6-4de7-8254-7c9b98e6e18d tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:17.567582 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0fce7c74-e4e6-4de7-8254-7c9b98e6e18d tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:17.568537 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0fce7c74-e4e6-4de7-8254-7c9b98e6e18d tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:17.569170 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0fce7c74-e4e6-4de7-8254-7c9b98e6e18d tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:17.718637 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0fce7c74-e4e6-4de7-8254-7c9b98e6e18d tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:17.727128 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0fce7c74-e4e6-4de7-8254-7c9b98e6e18d tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4" status: 200 len: 1314 microversion: 2.1 time: 0.172671 Jun 27 21:23:17.727893 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 421/874] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:17 2022] GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:23:18.582799 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-35bd7ae2-9e75-4bea-b1c3-e94c1e255950 req-0a9d7980-a827-4377-b6f4-3ebbe026a3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4", "name": "network-vif-plugged", "status": "completed", "tag": "5e9dc96f-1bf7-4645-a8e5-8a7436dd3593"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:23:18.592662 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-35bd7ae2-9e75-4bea-b1c3-e94c1e255950 req-0a9d7980-a827-4377-b6f4-3ebbe026a3f4 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:18.593125 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-35bd7ae2-9e75-4bea-b1c3-e94c1e255950 req-0a9d7980-a827-4377-b6f4-3ebbe026a3f4 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:18.607383 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-35bd7ae2-9e75-4bea-b1c3-e94c1e255950 req-0a9d7980-a827-4377-b6f4-3ebbe026a3f4 service nova] Creating event network-vif-plugged:5e9dc96f-1bf7-4645-a8e5-8a7436dd3593 for instance d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 on hv-cinder-84773 Jun 27 21:23:18.612530 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-35bd7ae2-9e75-4bea-b1c3-e94c1e255950 req-0a9d7980-a827-4377-b6f4-3ebbe026a3f4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033829 Jun 27 21:23:18.613360 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 454/875] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:23:18.743924 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8bf7ac83-8fc4-4db3-b3a1-5c76b359423f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:18.744593 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8bf7ac83-8fc4-4db3-b3a1-5c76b359423f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:18.753891 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8bf7ac83-8fc4-4db3-b3a1-5c76b359423f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:18.754368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8bf7ac83-8fc4-4db3-b3a1-5c76b359423f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:18.755476 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8bf7ac83-8fc4-4db3-b3a1-5c76b359423f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:18.762149 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8bf7ac83-8fc4-4db3-b3a1-5c76b359423f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:18.963678 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8bf7ac83-8fc4-4db3-b3a1-5c76b359423f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:18.971616 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8bf7ac83-8fc4-4db3-b3a1-5c76b359423f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4" status: 200 len: 1314 microversion: 2.1 time: 0.231501 Jun 27 21:23:18.972246 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 422/876] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:18 2022] GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:19.990424 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-fc8c1337-3472-474e-b031-5bec6b775191 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:19.991234 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-fc8c1337-3472-474e-b031-5bec6b775191 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:19.998143 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fc8c1337-3472-474e-b031-5bec6b775191 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:19.998586 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fc8c1337-3472-474e-b031-5bec6b775191 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:19.999354 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fc8c1337-3472-474e-b031-5bec6b775191 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:19.999783 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fc8c1337-3472-474e-b031-5bec6b775191 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:20.130365 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:23:20.135119 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-fc8c1337-3472-474e-b031-5bec6b775191 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:20.142984 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-fc8c1337-3472-474e-b031-5bec6b775191 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4" status: 200 len: 1314 microversion: 2.1 time: 0.157330 Jun 27 21:23:20.143561 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 455/877] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:19 2022] GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:21.160420 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a32f0eb9-d0f2-42a8-8d18-4e4303a220a6 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:21.161103 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a32f0eb9-d0f2-42a8-8d18-4e4303a220a6 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:21.164248 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:23:21.164908 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:23:21.171027 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a32f0eb9-d0f2-42a8-8d18-4e4303a220a6 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:21.171450 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a32f0eb9-d0f2-42a8-8d18-4e4303a220a6 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:21.172242 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a32f0eb9-d0f2-42a8-8d18-4e4303a220a6 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:21.172665 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a32f0eb9-d0f2-42a8-8d18-4e4303a220a6 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:21.311810 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a32f0eb9-d0f2-42a8-8d18-4e4303a220a6 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:21.320557 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a32f0eb9-d0f2-42a8-8d18-4e4303a220a6 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4" status: 200 len: 1499 microversion: 2.1 time: 0.164094 Jun 27 21:23:21.321219 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 423/878] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:21 2022] GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 => generated 1499 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:22.039531 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ba043ace-f41b-49f7-8086-573a1fd730e9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:22.040060 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ba043ace-f41b-49f7-8086-573a1fd730e9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:22.046703 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ba043ace-f41b-49f7-8086-573a1fd730e9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:22.047154 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ba043ace-f41b-49f7-8086-573a1fd730e9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:22.047917 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ba043ace-f41b-49f7-8086-573a1fd730e9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:22.048347 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ba043ace-f41b-49f7-8086-573a1fd730e9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:22.075957 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ba043ace-f41b-49f7-8086-573a1fd730e9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4] Going to try to terminate instance {{(pid=117891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:23:22.159942 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ba043ace-f41b-49f7-8086-573a1fd730e9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4" status: 204 len: 0 microversion: 2.1 time: 0.124115 Jun 27 21:23:22.163945 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 456/879] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:23:22 2022] DELETE /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:23:22.169313 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fb5ce738-c941-46cb-856f-f2e4778ef830 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:22.170024 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fb5ce738-c941-46cb-856f-f2e4778ef830 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:22.176700 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb5ce738-c941-46cb-856f-f2e4778ef830 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:22.177062 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb5ce738-c941-46cb-856f-f2e4778ef830 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:22.177832 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb5ce738-c941-46cb-856f-f2e4778ef830 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:22.178372 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb5ce738-c941-46cb-856f-f2e4778ef830 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:22.318217 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fb5ce738-c941-46cb-856f-f2e4778ef830 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:22.327139 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fb5ce738-c941-46cb-856f-f2e4778ef830 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4" status: 200 len: 1505 microversion: 2.1 time: 0.161767 Jun 27 21:23:22.328013 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 424/880] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:22 2022] GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:23:23.345569 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-230c4b35-61b2-4a2c-9d76-8c9e7903046b tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:23.346250 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-230c4b35-61b2-4a2c-9d76-8c9e7903046b tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:23.354442 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-230c4b35-61b2-4a2c-9d76-8c9e7903046b tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:23.354880 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-230c4b35-61b2-4a2c-9d76-8c9e7903046b tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:23.355659 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-230c4b35-61b2-4a2c-9d76-8c9e7903046b tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:23.356078 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-230c4b35-61b2-4a2c-9d76-8c9e7903046b tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:23.492684 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-230c4b35-61b2-4a2c-9d76-8c9e7903046b tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:23.500503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-230c4b35-61b2-4a2c-9d76-8c9e7903046b tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4" status: 200 len: 1505 microversion: 2.1 time: 0.159307 Jun 27 21:23:23.501084 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 457/881] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:23 2022] GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:24.518523 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2831bb2c-4341-4ab1-93e4-c9d67b658aeb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:24.519118 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2831bb2c-4341-4ab1-93e4-c9d67b658aeb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:24.521689 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:23:24.527504 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2831bb2c-4341-4ab1-93e4-c9d67b658aeb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:24.527953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2831bb2c-4341-4ab1-93e4-c9d67b658aeb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:24.528733 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2831bb2c-4341-4ab1-93e4-c9d67b658aeb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:24.529200 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2831bb2c-4341-4ab1-93e4-c9d67b658aeb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:24.664905 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2831bb2c-4341-4ab1-93e4-c9d67b658aeb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:24.673053 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2831bb2c-4341-4ab1-93e4-c9d67b658aeb tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4" status: 200 len: 1505 microversion: 2.1 time: 0.158400 Jun 27 21:23:24.673617 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 425/882] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:24 2022] GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:25.691021 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f4eba28f-bdd5-42d8-bba9-3f4a5de24cb3 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:25.691645 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f4eba28f-bdd5-42d8-bba9-3f4a5de24cb3 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:25.698769 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f4eba28f-bdd5-42d8-bba9-3f4a5de24cb3 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:25.699213 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f4eba28f-bdd5-42d8-bba9-3f4a5de24cb3 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:25.700004 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f4eba28f-bdd5-42d8-bba9-3f4a5de24cb3 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:25.700406 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f4eba28f-bdd5-42d8-bba9-3f4a5de24cb3 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:25.836055 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f4eba28f-bdd5-42d8-bba9-3f4a5de24cb3 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:25.844063 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f4eba28f-bdd5-42d8-bba9-3f4a5de24cb3 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4" status: 200 len: 1505 microversion: 2.1 time: 0.157228 Jun 27 21:23:25.844677 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 458/883] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:25 2022] GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:26.861993 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1c18ce83-c806-4795-882a-a3a7d7fb0ed9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:26.862555 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1c18ce83-c806-4795-882a-a3a7d7fb0ed9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:26.869834 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1c18ce83-c806-4795-882a-a3a7d7fb0ed9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:26.870267 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1c18ce83-c806-4795-882a-a3a7d7fb0ed9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:26.871025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1c18ce83-c806-4795-882a-a3a7d7fb0ed9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:26.871449 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1c18ce83-c806-4795-882a-a3a7d7fb0ed9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:27.011866 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1c18ce83-c806-4795-882a-a3a7d7fb0ed9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:27.020120 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1c18ce83-c806-4795-882a-a3a7d7fb0ed9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4" status: 200 len: 1505 microversion: 2.1 time: 0.162261 Jun 27 21:23:27.020702 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 426/884] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:26 2022] GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:28.038614 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e195bc00-db0e-4fd7-93e0-bed3f35f310f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:28.039238 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e195bc00-db0e-4fd7-93e0-bed3f35f310f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:28.046027 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e195bc00-db0e-4fd7-93e0-bed3f35f310f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:28.046474 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e195bc00-db0e-4fd7-93e0-bed3f35f310f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:28.047246 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e195bc00-db0e-4fd7-93e0-bed3f35f310f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:28.047677 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e195bc00-db0e-4fd7-93e0-bed3f35f310f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:28.183850 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e195bc00-db0e-4fd7-93e0-bed3f35f310f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:28.192274 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e195bc00-db0e-4fd7-93e0-bed3f35f310f tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4" status: 200 len: 1505 microversion: 2.1 time: 0.157606 Jun 27 21:23:28.192651 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 459/885] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:28 2022] GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:28.633589 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-31183984-2254-4835-8546-8d9666c121c1 req-f8a2ac65-ff18-4f82-ac36-2fdb5ae405e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4", "name": "network-vif-deleted", "tag": "5e9dc96f-1bf7-4645-a8e5-8a7436dd3593"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:23:28.642731 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-31183984-2254-4835-8546-8d9666c121c1 req-f8a2ac65-ff18-4f82-ac36-2fdb5ae405e0 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:28.643160 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-31183984-2254-4835-8546-8d9666c121c1 req-f8a2ac65-ff18-4f82-ac36-2fdb5ae405e0 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:28.654634 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-31183984-2254-4835-8546-8d9666c121c1 req-f8a2ac65-ff18-4f82-ac36-2fdb5ae405e0 service nova] Creating event network-vif-deleted:5e9dc96f-1bf7-4645-a8e5-8a7436dd3593 for instance d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 on hv-cinder-84773 Jun 27 21:23:28.659524 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-31183984-2254-4835-8546-8d9666c121c1 req-f8a2ac65-ff18-4f82-ac36-2fdb5ae405e0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029663 Jun 27 21:23:28.660105 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 427/886] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:23:29.209266 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f4999ba7-0bfe-406e-acf0-d9e6b49919f1 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:29.210041 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f4999ba7-0bfe-406e-acf0-d9e6b49919f1 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:29.216943 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f4999ba7-0bfe-406e-acf0-d9e6b49919f1 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:29.217419 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f4999ba7-0bfe-406e-acf0-d9e6b49919f1 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:29.218186 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f4999ba7-0bfe-406e-acf0-d9e6b49919f1 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:29.218622 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f4999ba7-0bfe-406e-acf0-d9e6b49919f1 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:29.236419 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:23:29.289014 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f4999ba7-0bfe-406e-acf0-d9e6b49919f1 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:29.297060 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f4999ba7-0bfe-406e-acf0-d9e6b49919f1 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4" status: 200 len: 1463 microversion: 2.1 time: 0.092363 Jun 27 21:23:29.297677 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 460/887] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:29 2022] GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 => generated 1463 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:30.315710 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f0b03bd1-9bdf-42b7-ab78-9e99ef199c77 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:30.316293 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f0b03bd1-9bdf-42b7-ab78-9e99ef199c77 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:30.323486 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f0b03bd1-9bdf-42b7-ab78-9e99ef199c77 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:30.323913 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f0b03bd1-9bdf-42b7-ab78-9e99ef199c77 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:30.324669 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f0b03bd1-9bdf-42b7-ab78-9e99ef199c77 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:30.325134 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f0b03bd1-9bdf-42b7-ab78-9e99ef199c77 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:30.390644 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f0b03bd1-9bdf-42b7-ab78-9e99ef199c77 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:30.398813 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f0b03bd1-9bdf-42b7-ab78-9e99ef199c77 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4" status: 200 len: 1299 microversion: 2.1 time: 0.088040 Jun 27 21:23:30.399394 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 428/888] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:30 2022] GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:31.417633 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7b68ae18-4af6-4f21-8d56-1c80d8a3cf07 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:31.418305 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7b68ae18-4af6-4f21-8d56-1c80d8a3cf07 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:31.425494 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7b68ae18-4af6-4f21-8d56-1c80d8a3cf07 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:31.426004 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7b68ae18-4af6-4f21-8d56-1c80d8a3cf07 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:31.426906 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7b68ae18-4af6-4f21-8d56-1c80d8a3cf07 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:31.427539 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7b68ae18-4af6-4f21-8d56-1c80d8a3cf07 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:31.462349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7b68ae18-4af6-4f21-8d56-1c80d8a3cf07 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:31.462793 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7b68ae18-4af6-4f21-8d56-1c80d8a3cf07 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:31.463236 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-7b68ae18-4af6-4f21-8d56-1c80d8a3cf07 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lazy-loading 'fault' on Instance uuid d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:23:31.511600 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7b68ae18-4af6-4f21-8d56-1c80d8a3cf07 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e171895ccc4f1cbc69ead21175fc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70340671074b2aa4c80384cb6f1c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:31.519316 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7b68ae18-4af6-4f21-8d56-1c80d8a3cf07 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4" status: 200 len: 1304 microversion: 2.1 time: 0.106476 Jun 27 21:23:31.519895 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 461/889] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:31 2022] GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:32.538077 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2bb61f05-e9c1-4c11-b9e1-cd140a75ddb9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:32.539315 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2bb61f05-e9c1-4c11-b9e1-cd140a75ddb9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] [instance: d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:32.546355 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2bb61f05-e9c1-4c11-b9e1-cd140a75ddb9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:32.546891 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2bb61f05-e9c1-4c11-b9e1-cd140a75ddb9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:32.547814 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2bb61f05-e9c1-4c11-b9e1-cd140a75ddb9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:32.548258 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2bb61f05-e9c1-4c11-b9e1-cd140a75ddb9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:32.562385 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-2bb61f05-e9c1-4c11-b9e1-cd140a75ddb9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] HTTP exception thrown: Instance d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 could not be found. Jun 27 21:23:32.564066 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2bb61f05-e9c1-4c11-b9e1-cd140a75ddb9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Request method failure captured: Jun 27 21:23:32.564066 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 HTTP/1.1 Jun 27 21:23:32.564066 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:23:32.564066 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:23:32.564066 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:23:32.564066 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:23:32.564066 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:23:32.564066 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:23:32.564066 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:23:32.564066 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:23:32.564066 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh-kMVtNWGmprU8r6fIdc3nAoJ453mFQEUYKBwARi_Mnzol5MxGzSt452oBKqgo3bU4Rm0mxwm-FnYwXCL_SiKJ04RfjvS8QDbWNG9KI0yTcdxpYUk89QfnBS86Q7FkcB4RWK1-PJog0yanIRziJZ_xtoAhfxtRY6v6CzjZQ6zJvL8E Jun 27 21:23:32.564066 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:23:32.564066 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:23:32.564066 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:23:32.564066 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:23:32.564066 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:23:32.564066 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:23:32.564066 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 8b70340671074b2aa4c80384cb6f1c85 Jun 27 21:23:32.564066 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesActionsTest-2053792718 Jun 27 21:23:32.564066 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:23:32.564066 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:23:32.565537 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8b70340671074b2aa4c80384cb6f1c85", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8b70340671074b2aa4c80384cb6f1c85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8b70340671074b2aa4c80384cb6f1c85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8b70340671074b2aa4c80384cb6f1c85"}]}] Jun 27 21:23:32.565537 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesActionsTest-2053792718 Jun 27 21:23:32.565537 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 8b70340671074b2aa4c80384cb6f1c85 Jun 27 21:23:32.565537 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesActionsTest-2053792718 Jun 27 21:23:32.565537 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesActionsTest-2053792718-project Jun 27 21:23:32.565537 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:23:32.565537 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:23:32.565537 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: e0e171895ccc4f1cbc69ead21175fc5d Jun 27 21:23:32.565537 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesActionsTest-2053792718-project Jun 27 21:23:32.565537 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:23:32.565537 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 could not be found. Jun 27 21:23:32.565537 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': 'd1f24508-cc1a-4fbc-804e-bfbfc6b19ae4'} Jun 27 21:23:32.569448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:23:32.569448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:32.569448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:23:32.569448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:23:32.569448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:23:32.569448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:23:32.569448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:23:32.569448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:23:32.569448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:23:32.569448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:23:32.569448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 could not be found. Jun 27 21:23:32.569448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:23:32.569448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:23:32.569448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:23:32.569448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:32.569448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:23:32.569448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:23:32.569448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:23:32.569448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:23:32.569448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:23:32.570968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:23:32.570968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:23:32.570968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:23:32.570968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:23:32.570968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:23:32.570968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:23:32.570968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:23:32.570968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 could not be found. Jun 27 21:23:32.570968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:23:32.570968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:23:32.570968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:23:32.570968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:32.570968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:23:32.570968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:23:32.570968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:23:32.570968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:23:32.570968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 could not be found. Jun 27 21:23:32.570968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:23:32.572143 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2bb61f05-e9c1-4c11-b9e1-cd140a75ddb9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] Returning 404 to user: Instance d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:23:32.572143 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2bb61f05-e9c1-4c11-b9e1-cd140a75ddb9 tempest-VolumesActionsTest-2053792718 tempest-VolumesActionsTest-2053792718-project] 10.222.0.13 "GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4" status: 404 len: 111 microversion: 2.1 time: 0.031765 Jun 27 21:23:32.572143 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 429/890] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:32 2022] GET /compute/v2.1/servers/d1f24508-cc1a-4fbc-804e-bfbfc6b19ae4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:24:29.604418 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1033547c-e55c-4743-af99-6e07df9eaf15 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Action: 'create', calling method: .version_select at 0x7f834f223dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1445052348", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeP4Uwm0wdiMeMYRdJX4Vu214mev1518YrY2BBN4mWmAdVL7IcaIHvSJYr3IKECwMUlIYN8HZACGiiwqG6H8iC/ywZ+nIXPUEXnp7lwq3P8keqPpFMJFKLilFLaWuSmeg=="}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:29.611917 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:29.613012 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=11 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:29.631310 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-1033547c-e55c-4743-af99-6e07df9eaf15 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Getting quotas for project c9f86d6febe04e8f9745d787914b6d5c. Resources: {'key_pairs'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:24:29.635591 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-1033547c-e55c-4743-af99-6e07df9eaf15 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Getting quotas for user 4d867759b4f249a393598964774a22fa and project c9f86d6febe04e8f9745d787914b6d5c. Resources: {'key_pairs'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:24:29.660504 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1033547c-e55c-4743-af99-6e07df9eaf15 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.060662 Jun 27 21:24:29.661146 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 462/891] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 27 21:24:29 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:24:29.774391 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-08c66477-d5b1-4f88-8af9-f24236801c32 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2055091038", "imageRef": "57d3ba08-84dd-4ac5-a07a-c21728ee85a2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1445052348", "networks": [{"uuid": "34d52971-c53b-4ea9-9d05-eaeb67e201df"}]}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:29.781840 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=9 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:29.782499 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=49 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:29.834522 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-08c66477-d5b1-4f88-8af9-f24236801c32 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] validate_networks() for [('34d52971-c53b-4ea9-9d05-eaeb67e201df', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:24:30.226914 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-08c66477-d5b1-4f88-8af9-f24236801c32 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:24:30.227333 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-08c66477-d5b1-4f88-8af9-f24236801c32 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:24:30.227802 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-08c66477-d5b1-4f88-8af9-f24236801c32 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:24:30.228206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-08c66477-d5b1-4f88-8af9-f24236801c32 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:24:30.228606 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-08c66477-d5b1-4f88-8af9-f24236801c32 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:24:30.239608 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-08c66477-d5b1-4f88-8af9-f24236801c32 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:30.240079 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-08c66477-d5b1-4f88-8af9-f24236801c32 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:30.240876 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-08c66477-d5b1-4f88-8af9-f24236801c32 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:30.241337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-08c66477-d5b1-4f88-8af9-f24236801c32 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:30.258572 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-08c66477-d5b1-4f88-8af9-f24236801c32 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Getting quotas for project c9f86d6febe04e8f9745d787914b6d5c. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:24:30.262752 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-08c66477-d5b1-4f88-8af9-f24236801c32 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Getting quotas for user 4d867759b4f249a393598964774a22fa and project c9f86d6febe04e8f9745d787914b6d5c. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:24:30.274591 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-08c66477-d5b1-4f88-8af9-f24236801c32 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:24:30.276728 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-08c66477-d5b1-4f88-8af9-f24236801c32 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57d3ba08-84dd-4ac5-a07a-c21728ee85a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:24:30.325495 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-08c66477-d5b1-4f88-8af9-f24236801c32 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555135 Jun 27 21:24:30.326168 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 430/892] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 27 21:24:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 21:24:30.337733 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b130651d-93a3-4e72-aad9-7776cf1d3d9b tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:30.338352 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b130651d-93a3-4e72-aad9-7776cf1d3d9b tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:30.404030 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b130651d-93a3-4e72-aad9-7776cf1d3d9b tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:30.412071 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b130651d-93a3-4e72-aad9-7776cf1d3d9b tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1259 microversion: 2.1 time: 0.078573 Jun 27 21:24:30.412396 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 463/893] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:30 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1259 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:31.430864 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1a017743-5363-4772-aa10-895a91c00bdc tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:31.431492 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1a017743-5363-4772-aa10-895a91c00bdc tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:31.438223 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1a017743-5363-4772-aa10-895a91c00bdc tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:31.438671 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1a017743-5363-4772-aa10-895a91c00bdc tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:31.439703 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1a017743-5363-4772-aa10-895a91c00bdc tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:31.440128 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1a017743-5363-4772-aa10-895a91c00bdc tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:31.507276 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1a017743-5363-4772-aa10-895a91c00bdc tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:31.515255 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1a017743-5363-4772-aa10-895a91c00bdc tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1311 microversion: 2.1 time: 0.089691 Jun 27 21:24:31.515834 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 431/894] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:31 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1311 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:32.531755 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-fe237c03-1332-48f9-ba84-22b581168061 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:32.533484 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-fe237c03-1332-48f9-ba84-22b581168061 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:32.547056 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fe237c03-1332-48f9-ba84-22b581168061 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:32.552764 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fe237c03-1332-48f9-ba84-22b581168061 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:32.557338 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fe237c03-1332-48f9-ba84-22b581168061 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:32.558581 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fe237c03-1332-48f9-ba84-22b581168061 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:32.809549 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-fe237c03-1332-48f9-ba84-22b581168061 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:32.823836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-fe237c03-1332-48f9-ba84-22b581168061 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1359 microversion: 2.1 time: 0.295918 Jun 27 21:24:32.827393 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 464/895] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:32 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1359 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:33.851312 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4c0f507b-8384-4049-af73-9dad4f9cd9c0 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:33.853081 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4c0f507b-8384-4049-af73-9dad4f9cd9c0 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:33.876191 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4c0f507b-8384-4049-af73-9dad4f9cd9c0 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:33.878930 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4c0f507b-8384-4049-af73-9dad4f9cd9c0 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:33.881847 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4c0f507b-8384-4049-af73-9dad4f9cd9c0 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:33.883651 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4c0f507b-8384-4049-af73-9dad4f9cd9c0 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:34.183973 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-ceede5a4-a3a6-4638-928f-65bea0e9b307 req-c9b74351-06c1-47d4-aef4-ecc465fb7b56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d342f76-2548-4bed-8f8e-1b722c8e61e3", "tag": "327711ca-a708-4b77-8455-a571c628332b"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:34.206788 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-ceede5a4-a3a6-4638-928f-65bea0e9b307 req-c9b74351-06c1-47d4-aef4-ecc465fb7b56 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:34.207376 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-ceede5a4-a3a6-4638-928f-65bea0e9b307 req-c9b74351-06c1-47d4-aef4-ecc465fb7b56 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:34.228681 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4c0f507b-8384-4049-af73-9dad4f9cd9c0 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:34.242297 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4c0f507b-8384-4049-af73-9dad4f9cd9c0 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1359 microversion: 2.1 time: 0.400297 Jun 27 21:24:34.254028 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 432/896] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:33 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1359 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:34.261974 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-ceede5a4-a3a6-4638-928f-65bea0e9b307 req-c9b74351-06c1-47d4-aef4-ecc465fb7b56 service nova] Creating event network-changed:327711ca-a708-4b77-8455-a571c628332b for instance 3d342f76-2548-4bed-8f8e-1b722c8e61e3 on hv-cinder-84773 Jun 27 21:24:34.271285 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-ceede5a4-a3a6-4638-928f-65bea0e9b307 req-c9b74351-06c1-47d4-aef4-ecc465fb7b56 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091445 Jun 27 21:24:34.275003 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 465/897] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:24:35.280013 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b69521ef-1c65-4156-a2ac-985181644e6f tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:35.280698 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b69521ef-1c65-4156-a2ac-985181644e6f tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:35.298868 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b69521ef-1c65-4156-a2ac-985181644e6f tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:35.299700 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b69521ef-1c65-4156-a2ac-985181644e6f tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:35.300889 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b69521ef-1c65-4156-a2ac-985181644e6f tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:35.301354 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b69521ef-1c65-4156-a2ac-985181644e6f tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:35.477986 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b69521ef-1c65-4156-a2ac-985181644e6f tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:35.489134 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b69521ef-1c65-4156-a2ac-985181644e6f tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1359 microversion: 2.1 time: 0.213248 Jun 27 21:24:35.505128 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 433/898] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:35 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:36.509474 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6d9e0e70-453e-4520-8d14-61531b88edab tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:36.510227 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6d9e0e70-453e-4520-8d14-61531b88edab tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:36.524201 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6d9e0e70-453e-4520-8d14-61531b88edab tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:36.524662 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6d9e0e70-453e-4520-8d14-61531b88edab tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:36.525484 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6d9e0e70-453e-4520-8d14-61531b88edab tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:36.526177 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6d9e0e70-453e-4520-8d14-61531b88edab tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:36.748350 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-6d9e0e70-453e-4520-8d14-61531b88edab tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:36.758882 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6d9e0e70-453e-4520-8d14-61531b88edab tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1359 microversion: 2.1 time: 0.254118 Jun 27 21:24:36.770667 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 466/899] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:36 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1359 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:37.778463 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4268178e-1f14-4fde-91a4-abdfdc6cc1e3 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:37.779158 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4268178e-1f14-4fde-91a4-abdfdc6cc1e3 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:37.786180 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4268178e-1f14-4fde-91a4-abdfdc6cc1e3 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:37.786786 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4268178e-1f14-4fde-91a4-abdfdc6cc1e3 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:37.787857 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4268178e-1f14-4fde-91a4-abdfdc6cc1e3 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:37.788500 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4268178e-1f14-4fde-91a4-abdfdc6cc1e3 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:37.939965 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4268178e-1f14-4fde-91a4-abdfdc6cc1e3 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:37.949981 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4268178e-1f14-4fde-91a4-abdfdc6cc1e3 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1359 microversion: 2.1 time: 0.176014 Jun 27 21:24:37.961035 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 434/900] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:37 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:38.667757 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6be8849c-9d49-434d-a70b-76d73c3e7c54 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1089349159", "imageRef": "3155f228-b1ff-487e-837f-85eec68c250a", "flavorRef": "452", "networks": [{"uuid": "df906fd9-a04e-4365-8460-c42478a9b69b"}]}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:38.725359 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.network.neutron [None req-6be8849c-9d49-434d-a70b-76d73c3e7c54 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] validate_networks() for [('df906fd9-a04e-4365-8460-c42478a9b69b', None, None, None, None, None)] {{(pid=117891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:24:38.967044 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-db21d2bb-cabd-4d70-9ad6-8d3a2c896c51 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:38.968290 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-db21d2bb-cabd-4d70-9ad6-8d3a2c896c51 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:38.986998 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db21d2bb-cabd-4d70-9ad6-8d3a2c896c51 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:38.987455 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db21d2bb-cabd-4d70-9ad6-8d3a2c896c51 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:38.988250 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db21d2bb-cabd-4d70-9ad6-8d3a2c896c51 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:38.988682 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db21d2bb-cabd-4d70-9ad6-8d3a2c896c51 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:39.024364 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-db21d2bb-cabd-4d70-9ad6-8d3a2c896c51 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:24:39.191603 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-6be8849c-9d49-434d-a70b-76d73c3e7c54 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Flavor limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:24:39.192405 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-6be8849c-9d49-434d-a70b-76d73c3e7c54 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Image limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:24:39.193458 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-6be8849c-9d49-434d-a70b-76d73c3e7c54 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Flavor pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:24:39.194085 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-6be8849c-9d49-434d-a70b-76d73c3e7c54 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Image pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:24:39.194708 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-6be8849c-9d49-434d-a70b-76d73c3e7c54 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:24:39.202804 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-db21d2bb-cabd-4d70-9ad6-8d3a2c896c51 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 204 len: 0 microversion: 2.1 time: 0.238074 Jun 27 21:24:39.204274 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 435/901] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:24:38 2022] DELETE /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 21:24:39.208667 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6be8849c-9d49-434d-a70b-76d73c3e7c54 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:39.209525 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6be8849c-9d49-434d-a70b-76d73c3e7c54 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:39.211089 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6be8849c-9d49-434d-a70b-76d73c3e7c54 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:39.211890 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6be8849c-9d49-434d-a70b-76d73c3e7c54 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:39.215508 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2066b197-30e3-4f4c-b6d1-9b446ea07732 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:39.217194 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2066b197-30e3-4f4c-b6d1-9b446ea07732 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:39.229506 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2066b197-30e3-4f4c-b6d1-9b446ea07732 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:39.230220 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2066b197-30e3-4f4c-b6d1-9b446ea07732 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:39.231801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2066b197-30e3-4f4c-b6d1-9b446ea07732 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:39.232602 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2066b197-30e3-4f4c-b6d1-9b446ea07732 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:39.256175 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-6be8849c-9d49-434d-a70b-76d73c3e7c54 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Getting quotas for project 30944911cb4b49129983d5c19ca7a6bb. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:24:39.263997 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-6be8849c-9d49-434d-a70b-76d73c3e7c54 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Getting quotas for user c2aa9bdeb9984336bdf103f2d6b1dc13 and project 30944911cb4b49129983d5c19ca7a6bb. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:24:39.283918 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6be8849c-9d49-434d-a70b-76d73c3e7c54 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Going to run 1 instances... {{(pid=117891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:24:39.287899 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6be8849c-9d49-434d-a70b-76d73c3e7c54 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: b9c20f29-5815-4489-a5fc-7a5ee23b071c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3155f228-b1ff-487e-837f-85eec68c250a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:24:39.355235 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6be8849c-9d49-434d-a70b-76d73c3e7c54 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691273 Jun 27 21:24:39.356333 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 467/902] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 27 21:24:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:24:39.365831 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0e788ba9-8117-4bb6-9d61-5eda718c5cea tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:39.366618 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0e788ba9-8117-4bb6-9d61-5eda718c5cea tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:39.376143 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0e788ba9-8117-4bb6-9d61-5eda718c5cea tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:39.376984 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0e788ba9-8117-4bb6-9d61-5eda718c5cea tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:39.378023 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0e788ba9-8117-4bb6-9d61-5eda718c5cea tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:39.378677 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0e788ba9-8117-4bb6-9d61-5eda718c5cea tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:39.526271 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2066b197-30e3-4f4c-b6d1-9b446ea07732 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:39.535088 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2066b197-30e3-4f4c-b6d1-9b446ea07732 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1359 microversion: 2.1 time: 0.328537 Jun 27 21:24:39.546512 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 436/903] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:39 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1359 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:39.551928 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-32b3f08a-670f-4d82-8615-6a6e603994ee tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:39.553703 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-32b3f08a-670f-4d82-8615-6a6e603994ee tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: b9c20f29-5815-4489-a5fc-7a5ee23b071c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:39.562462 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0e788ba9-8117-4bb6-9d61-5eda718c5cea tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:39.572543 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0e788ba9-8117-4bb6-9d61-5eda718c5cea tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 200 len: 1573 microversion: 2.1 time: 0.210843 Jun 27 21:24:39.590915 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 468/904] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:39 2022] GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 1573 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:39.623228 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-32b3f08a-670f-4d82-8615-6a6e603994ee tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:39.630728 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-32b3f08a-670f-4d82-8615-6a6e603994ee tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c" status: 200 len: 1219 microversion: 2.1 time: 0.082601 Jun 27 21:24:39.631888 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 437/905] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:39 2022] GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:40.553073 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3228115d-2028-4a16-a61a-3336649972ee tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:40.553753 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3228115d-2028-4a16-a61a-3336649972ee tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:40.560721 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3228115d-2028-4a16-a61a-3336649972ee tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:40.561210 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3228115d-2028-4a16-a61a-3336649972ee tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:40.561968 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3228115d-2028-4a16-a61a-3336649972ee tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:40.562466 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3228115d-2028-4a16-a61a-3336649972ee tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:40.598548 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d53172b9-0748-4737-a79f-931235feda72 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:40.599321 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d53172b9-0748-4737-a79f-931235feda72 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:40.602534 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:40.611382 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d53172b9-0748-4737-a79f-931235feda72 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:40.611823 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d53172b9-0748-4737-a79f-931235feda72 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:40.612596 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d53172b9-0748-4737-a79f-931235feda72 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:40.613064 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d53172b9-0748-4737-a79f-931235feda72 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:40.700807 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3228115d-2028-4a16-a61a-3336649972ee tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:40.709703 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3228115d-2028-4a16-a61a-3336649972ee tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1359 microversion: 2.1 time: 0.160753 Jun 27 21:24:40.710261 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 469/906] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:40 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:40.715743 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-71f1e06b-b89b-412c-b072-a402e460238e tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:40.716638 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-71f1e06b-b89b-412c-b072-a402e460238e tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: b9c20f29-5815-4489-a5fc-7a5ee23b071c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:40.723891 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-71f1e06b-b89b-412c-b072-a402e460238e tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:40.724539 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-71f1e06b-b89b-412c-b072-a402e460238e tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:40.725425 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-71f1e06b-b89b-412c-b072-a402e460238e tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:40.726093 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-71f1e06b-b89b-412c-b072-a402e460238e tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:40.754305 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d53172b9-0748-4737-a79f-931235feda72 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:40.762379 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d53172b9-0748-4737-a79f-931235feda72 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 200 len: 1573 microversion: 2.1 time: 0.167603 Jun 27 21:24:40.762969 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 438/907] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:40 2022] GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:24:40.790177 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-71f1e06b-b89b-412c-b072-a402e460238e tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:40.798197 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-71f1e06b-b89b-412c-b072-a402e460238e tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c" status: 200 len: 1223 microversion: 2.1 time: 0.086706 Jun 27 21:24:40.798744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 470/908] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:40 2022] GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:41.728501 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2b110779-7699-4238-a851-b5a832919dec tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:41.729168 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2b110779-7699-4238-a851-b5a832919dec tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:41.736606 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b110779-7699-4238-a851-b5a832919dec tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:41.737166 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b110779-7699-4238-a851-b5a832919dec tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:41.737969 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b110779-7699-4238-a851-b5a832919dec tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:41.738398 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b110779-7699-4238-a851-b5a832919dec tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:41.779564 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-33b09d6e-45fa-4f68-9e43-f87e6890b128 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:41.780194 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-33b09d6e-45fa-4f68-9e43-f87e6890b128 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:41.787214 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-33b09d6e-45fa-4f68-9e43-f87e6890b128 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:41.787888 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-33b09d6e-45fa-4f68-9e43-f87e6890b128 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:41.788766 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-33b09d6e-45fa-4f68-9e43-f87e6890b128 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:41.789269 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-33b09d6e-45fa-4f68-9e43-f87e6890b128 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:41.881538 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2b110779-7699-4238-a851-b5a832919dec tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:41.889789 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2b110779-7699-4238-a851-b5a832919dec tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1359 microversion: 2.1 time: 0.165267 Jun 27 21:24:41.890371 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 439/909] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:41 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:41.894896 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-501ce630-fa38-4623-b334-f2d5c5219c98 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:41.895502 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-501ce630-fa38-4623-b334-f2d5c5219c98 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: b9c20f29-5815-4489-a5fc-7a5ee23b071c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:41.902094 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-501ce630-fa38-4623-b334-f2d5c5219c98 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:41.902535 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-501ce630-fa38-4623-b334-f2d5c5219c98 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:41.903356 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-501ce630-fa38-4623-b334-f2d5c5219c98 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:41.903789 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-501ce630-fa38-4623-b334-f2d5c5219c98 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:41.940175 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-33b09d6e-45fa-4f68-9e43-f87e6890b128 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:41.948327 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-33b09d6e-45fa-4f68-9e43-f87e6890b128 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 200 len: 1573 microversion: 2.1 time: 0.172742 Jun 27 21:24:41.948911 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 471/910] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:41 2022] GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:24:41.971937 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-501ce630-fa38-4623-b334-f2d5c5219c98 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:41.979929 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-501ce630-fa38-4623-b334-f2d5c5219c98 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c" status: 200 len: 1223 microversion: 2.1 time: 0.088564 Jun 27 21:24:41.980506 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 440/911] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:41 2022] GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:42.910794 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-47b98b0a-32b4-4ca0-a18d-9b3ee518bd8a tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:42.912192 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-47b98b0a-32b4-4ca0-a18d-9b3ee518bd8a tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:42.919098 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-47b98b0a-32b4-4ca0-a18d-9b3ee518bd8a tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:42.919546 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-47b98b0a-32b4-4ca0-a18d-9b3ee518bd8a tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:42.920319 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-47b98b0a-32b4-4ca0-a18d-9b3ee518bd8a tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:42.920752 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-47b98b0a-32b4-4ca0-a18d-9b3ee518bd8a tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:42.967257 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9adceb7c-1c9d-4f2c-9e88-3830ba497bfc tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:42.967922 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9adceb7c-1c9d-4f2c-9e88-3830ba497bfc tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:42.974715 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9adceb7c-1c9d-4f2c-9e88-3830ba497bfc tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:42.975149 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9adceb7c-1c9d-4f2c-9e88-3830ba497bfc tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:42.975919 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9adceb7c-1c9d-4f2c-9e88-3830ba497bfc tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:42.976355 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9adceb7c-1c9d-4f2c-9e88-3830ba497bfc tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:43.059884 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-47b98b0a-32b4-4ca0-a18d-9b3ee518bd8a tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:43.068819 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-47b98b0a-32b4-4ca0-a18d-9b3ee518bd8a tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1359 microversion: 2.1 time: 0.163907 Jun 27 21:24:43.069467 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 472/912] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:42 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:43.074054 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-74b72c62-475d-4aa2-80bd-93420aed24f5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:43.074671 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-74b72c62-475d-4aa2-80bd-93420aed24f5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: b9c20f29-5815-4489-a5fc-7a5ee23b071c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:43.081388 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-74b72c62-475d-4aa2-80bd-93420aed24f5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:43.081836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-74b72c62-475d-4aa2-80bd-93420aed24f5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:43.082605 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-74b72c62-475d-4aa2-80bd-93420aed24f5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:43.083036 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-74b72c62-475d-4aa2-80bd-93420aed24f5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:43.167953 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-74b72c62-475d-4aa2-80bd-93420aed24f5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:43.183114 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-74b72c62-475d-4aa2-80bd-93420aed24f5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c" status: 200 len: 1271 microversion: 2.1 time: 0.112216 Jun 27 21:24:43.184504 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 473/913] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:43 2022] GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c => generated 1271 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:43.333016 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9adceb7c-1c9d-4f2c-9e88-3830ba497bfc tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:43.341447 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9adceb7c-1c9d-4f2c-9e88-3830ba497bfc tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 200 len: 1573 microversion: 2.1 time: 0.377900 Jun 27 21:24:43.342266 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 441/914] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:42 2022] GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 1573 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:24:44.086770 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8e2d10c7-bc1e-4696-a9ab-b4694168f661 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:44.087695 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-8e2d10c7-bc1e-4696-a9ab-b4694168f661 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:44.094714 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8e2d10c7-bc1e-4696-a9ab-b4694168f661 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:44.095239 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8e2d10c7-bc1e-4696-a9ab-b4694168f661 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:44.096128 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8e2d10c7-bc1e-4696-a9ab-b4694168f661 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:44.096547 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8e2d10c7-bc1e-4696-a9ab-b4694168f661 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:44.202686 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-718a27ea-9a12-4572-84dd-aceb28d35bd1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:44.203420 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-718a27ea-9a12-4572-84dd-aceb28d35bd1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: b9c20f29-5815-4489-a5fc-7a5ee23b071c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:44.212554 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-718a27ea-9a12-4572-84dd-aceb28d35bd1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:44.213404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-718a27ea-9a12-4572-84dd-aceb28d35bd1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:44.214274 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-718a27ea-9a12-4572-84dd-aceb28d35bd1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:44.214769 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-718a27ea-9a12-4572-84dd-aceb28d35bd1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:44.310009 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-718a27ea-9a12-4572-84dd-aceb28d35bd1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:44.321414 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-718a27ea-9a12-4572-84dd-aceb28d35bd1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c" status: 200 len: 1277 microversion: 2.1 time: 0.122825 Jun 27 21:24:44.331837 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 442/915] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:44 2022] GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:24:44.359941 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f313b3e5-4d9b-4a38-a258-9b46e9b93558 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:44.360652 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f313b3e5-4d9b-4a38-a258-9b46e9b93558 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:44.367497 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f313b3e5-4d9b-4a38-a258-9b46e9b93558 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:44.367953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f313b3e5-4d9b-4a38-a258-9b46e9b93558 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:44.368896 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f313b3e5-4d9b-4a38-a258-9b46e9b93558 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:44.369369 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f313b3e5-4d9b-4a38-a258-9b46e9b93558 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:44.476480 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f313b3e5-4d9b-4a38-a258-9b46e9b93558 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:44.484534 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f313b3e5-4d9b-4a38-a258-9b46e9b93558 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 200 len: 1508 microversion: 2.1 time: 0.129272 Jun 27 21:24:44.493869 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 443/916] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:44 2022] GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 1508 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:44.515274 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8e2d10c7-bc1e-4696-a9ab-b4694168f661 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:44.524036 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8e2d10c7-bc1e-4696-a9ab-b4694168f661 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1359 microversion: 2.1 time: 0.441988 Jun 27 21:24:44.524613 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 474/917] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:44 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1359 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:44.869981 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-5bf1246e-3f6d-437b-81ab-fe4538b685be req-f3e37034-1ab5-4da8-9123-e6bd865ccdcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0641e731-c003-43d1-93c6-072ca2542d9f", "name": "network-vif-deleted", "tag": "75002039-0422-4d26-902e-76319b2a7e3b"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:44.887183 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-5bf1246e-3f6d-437b-81ab-fe4538b685be req-f3e37034-1ab5-4da8-9123-e6bd865ccdcf service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:44.888098 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-5bf1246e-3f6d-437b-81ab-fe4538b685be req-f3e37034-1ab5-4da8-9123-e6bd865ccdcf service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:44.911382 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-5bf1246e-3f6d-437b-81ab-fe4538b685be req-f3e37034-1ab5-4da8-9123-e6bd865ccdcf service nova] Creating event network-vif-deleted:75002039-0422-4d26-902e-76319b2a7e3b for instance 0641e731-c003-43d1-93c6-072ca2542d9f on hv-cinder-84773 Jun 27 21:24:44.918923 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-5bf1246e-3f6d-437b-81ab-fe4538b685be req-f3e37034-1ab5-4da8-9123-e6bd865ccdcf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063817 Jun 27 21:24:44.920338 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 444/918] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:24:45.339938 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9a86a761-8432-4eec-9821-5360ead4bbad tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:45.340539 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9a86a761-8432-4eec-9821-5360ead4bbad tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: b9c20f29-5815-4489-a5fc-7a5ee23b071c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:45.347821 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9a86a761-8432-4eec-9821-5360ead4bbad tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:45.348265 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9a86a761-8432-4eec-9821-5360ead4bbad tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:45.349463 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9a86a761-8432-4eec-9821-5360ead4bbad tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:45.350872 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9a86a761-8432-4eec-9821-5360ead4bbad tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:45.510281 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9a86a761-8432-4eec-9821-5360ead4bbad tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:45.515655 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-70204c19-9432-47ac-938f-dfd6a7df3025 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:45.518310 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9a86a761-8432-4eec-9821-5360ead4bbad tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c" status: 200 len: 1319 microversion: 2.1 time: 0.182524 Jun 27 21:24:45.518904 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 475/919] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:45 2022] GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:45.519618 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-70204c19-9432-47ac-938f-dfd6a7df3025 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:45.532448 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70204c19-9432-47ac-938f-dfd6a7df3025 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:45.533227 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70204c19-9432-47ac-938f-dfd6a7df3025 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:45.534463 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70204c19-9432-47ac-938f-dfd6a7df3025 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:45.535221 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70204c19-9432-47ac-938f-dfd6a7df3025 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:45.542052 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d6790a82-6274-4b02-bcf8-6aee19915bda tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:45.542843 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d6790a82-6274-4b02-bcf8-6aee19915bda tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:45.552276 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d6790a82-6274-4b02-bcf8-6aee19915bda tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:45.558726 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d6790a82-6274-4b02-bcf8-6aee19915bda tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:45.560380 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d6790a82-6274-4b02-bcf8-6aee19915bda tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:45.560839 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d6790a82-6274-4b02-bcf8-6aee19915bda tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:45.587411 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70204c19-9432-47ac-938f-dfd6a7df3025 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:45.589099 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70204c19-9432-47ac-938f-dfd6a7df3025 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:45.589840 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-70204c19-9432-47ac-938f-dfd6a7df3025 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lazy-loading 'fault' on Instance uuid 0641e731-c003-43d1-93c6-072ca2542d9f {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:24:45.675396 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-70204c19-9432-47ac-938f-dfd6a7df3025 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:45.687635 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-70204c19-9432-47ac-938f-dfd6a7df3025 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 200 len: 1230 microversion: 2.1 time: 0.190175 Jun 27 21:24:45.696682 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 445/920] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:45 2022] GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 1230 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:24:45.801889 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d6790a82-6274-4b02-bcf8-6aee19915bda tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:45.812275 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d6790a82-6274-4b02-bcf8-6aee19915bda tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1359 microversion: 2.1 time: 0.274107 Jun 27 21:24:45.813397 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 476/921] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:45 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1359 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:24:46.535659 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-34fe4369-1e25-4ad2-b7b0-d9a0ec057056 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:46.536204 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-34fe4369-1e25-4ad2-b7b0-d9a0ec057056 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: b9c20f29-5815-4489-a5fc-7a5ee23b071c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:46.543759 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-34fe4369-1e25-4ad2-b7b0-d9a0ec057056 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:46.544193 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-34fe4369-1e25-4ad2-b7b0-d9a0ec057056 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:46.544977 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-34fe4369-1e25-4ad2-b7b0-d9a0ec057056 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:46.545420 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-34fe4369-1e25-4ad2-b7b0-d9a0ec057056 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:46.682170 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-34fe4369-1e25-4ad2-b7b0-d9a0ec057056 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:46.685963 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:46.690874 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-34fe4369-1e25-4ad2-b7b0-d9a0ec057056 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c" status: 200 len: 1319 microversion: 2.1 time: 0.159259 Jun 27 21:24:46.691453 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 446/922] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:46 2022] GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:46.712220 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e73cf776-6ab0-4762-ab77-46c177824bd4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:46.712790 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e73cf776-6ab0-4762-ab77-46c177824bd4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:46.719965 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e73cf776-6ab0-4762-ab77-46c177824bd4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:46.720405 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e73cf776-6ab0-4762-ab77-46c177824bd4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:46.721211 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e73cf776-6ab0-4762-ab77-46c177824bd4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:46.721648 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e73cf776-6ab0-4762-ab77-46c177824bd4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:46.735530 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-e73cf776-6ab0-4762-ab77-46c177824bd4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] HTTP exception thrown: Instance 0641e731-c003-43d1-93c6-072ca2542d9f could not be found. Jun 27 21:24:46.737288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e73cf776-6ab0-4762-ab77-46c177824bd4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Request method failure captured: Jun 27 21:24:46.737288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f HTTP/1.1 Jun 27 21:24:46.737288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:24:46.737288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:24:46.737288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:24:46.737288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:24:46.737288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:24:46.737288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:24:46.737288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:24:46.737288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:24:46.737288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh9rBsXSISnkHy1jQit7xxhIkHj3UUTjTB0I8A21_aXJSQH1lsks8aurzJj6WR6bQ0Nf7CesV-aeeYKUP4_jdnhcNTHfuJ_kUfgVnKj466W12TCu5UJtv8DFApLsNt6LycoT4CuxfaZ_WKdfxtaLe1y1sANZzTESByabMYXXSip-mj8 Jun 27 21:24:46.737288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:24:46.737288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:24:46.737288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:24:46.737288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:24:46.737288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:24:46.737288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:24:46.737288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: 824cb65198bf417fbc4baeae349d358d Jun 27 21:24:46.737288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-TestVolumeBootPattern-1678295548 Jun 27 21:24:46.737288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:24:46.737288 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:24:46.738930 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_824cb65198bf417fbc4baeae349d358d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/824cb65198bf417fbc4baeae349d358d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/824cb65198bf417fbc4baeae349d358d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/824cb65198bf417fbc4baeae349d358d"}]}] Jun 27 21:24:46.738930 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-TestVolumeBootPattern-1678295548 Jun 27 21:24:46.738930 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 824cb65198bf417fbc4baeae349d358d Jun 27 21:24:46.738930 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-TestVolumeBootPattern-1678295548 Jun 27 21:24:46.738930 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-TestVolumeBootPattern-1678295548-project Jun 27 21:24:46.738930 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:24:46.738930 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:24:46.738930 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: e4b46dc825704fbc9cc2505805f22f94 Jun 27 21:24:46.738930 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-TestVolumeBootPattern-1678295548-project Jun 27 21:24:46.738930 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: > Jun 27 21:24:46.738930 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Instance 0641e731-c003-43d1-93c6-072ca2542d9f could not be found. Jun 27 21:24:46.738930 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'id': '0641e731-c003-43d1-93c6-072ca2542d9f'} Jun 27 21:24:46.740202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:24:46.740202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:24:46.740202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:24:46.740202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:24:46.740202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:24:46.740202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:24:46.740202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:24:46.740202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:24:46.740202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:24:46.740202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:24:46.740202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0641e731-c003-43d1-93c6-072ca2542d9f could not be found. Jun 27 21:24:46.740202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:24:46.740202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:24:46.740202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:24:46.740202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:24:46.740202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:24:46.740202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:24:46.740202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:24:46.740202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:24:46.740202 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:24:46.741772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:24:46.741772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:24:46.741772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:24:46.741772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:24:46.741772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:24:46.741772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:24:46.741772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:24:46.741772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0641e731-c003-43d1-93c6-072ca2542d9f could not be found. Jun 27 21:24:46.741772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:24:46.741772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:24:46.741772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:24:46.741772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:24:46.741772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:24:46.741772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:24:46.741772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:24:46.741772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:24:46.741772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0641e731-c003-43d1-93c6-072ca2542d9f could not be found. Jun 27 21:24:46.741772 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:24:46.743371 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e73cf776-6ab0-4762-ab77-46c177824bd4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Returning 404 to user: Instance 0641e731-c003-43d1-93c6-072ca2542d9f could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:24:46.743371 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e73cf776-6ab0-4762-ab77-46c177824bd4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 404 len: 111 microversion: 2.1 time: 0.030460 Jun 27 21:24:46.743371 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 477/923] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:46 2022] GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:24:46.830553 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bbacca29-2a1e-450c-aa8d-13d913dae526 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:46.831166 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bbacca29-2a1e-450c-aa8d-13d913dae526 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:46.838073 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bbacca29-2a1e-450c-aa8d-13d913dae526 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:46.838511 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bbacca29-2a1e-450c-aa8d-13d913dae526 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:46.839252 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bbacca29-2a1e-450c-aa8d-13d913dae526 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:46.839867 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bbacca29-2a1e-450c-aa8d-13d913dae526 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:46.846370 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-03907c9e-633f-4478-a373-a058f96d22bf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1025723299", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-621371235", "security_groups": [{"name": "tempest-secgroup-smoke-6158128"}], "block_device_mapping_v2": [{"uuid": "db1dc1d6-5331-41d3-91a8-171dc6013f30", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "09838620-b3d2-4651-acb5-4212286d0e49"}]}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:46.961110 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.network.neutron [None req-03907c9e-633f-4478-a373-a058f96d22bf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] validate_networks() for [('09838620-b3d2-4651-acb5-4212286d0e49', None, None, None, None, None)] {{(pid=117891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:24:46.991653 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bbacca29-2a1e-450c-aa8d-13d913dae526 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:47.000599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bbacca29-2a1e-450c-aa8d-13d913dae526 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1359 microversion: 2.1 time: 0.174164 Jun 27 21:24:47.001239 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 447/924] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:46 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:47.006024 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-d68250a0-4b5e-40da-9386-1afccf68a531 req-879d56c9-ecaf-4739-8480-c50cfda50780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9c20f29-5815-4489-a5fc-7a5ee23b071c", "tag": "ebca0722-12bd-4da8-bd7f-37c2b6cdd9f3"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:47.014470 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-d68250a0-4b5e-40da-9386-1afccf68a531 req-879d56c9-ecaf-4739-8480-c50cfda50780 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:47.014896 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-d68250a0-4b5e-40da-9386-1afccf68a531 req-879d56c9-ecaf-4739-8480-c50cfda50780 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:47.027274 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-d68250a0-4b5e-40da-9386-1afccf68a531 req-879d56c9-ecaf-4739-8480-c50cfda50780 service nova] Creating event network-changed:ebca0722-12bd-4da8-bd7f-37c2b6cdd9f3 for instance b9c20f29-5815-4489-a5fc-7a5ee23b071c on hv-cinder-84773 Jun 27 21:24:47.032584 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-d68250a0-4b5e-40da-9386-1afccf68a531 req-879d56c9-ecaf-4739-8480-c50cfda50780 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030173 Jun 27 21:24:47.033226 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 448/925] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:24:47.347526 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-03907c9e-633f-4478-a373-a058f96d22bf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Flavor limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:24:47.347940 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-03907c9e-633f-4478-a373-a058f96d22bf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Image limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:24:47.348409 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-03907c9e-633f-4478-a373-a058f96d22bf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Flavor pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:24:47.348855 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-03907c9e-633f-4478-a373-a058f96d22bf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Image pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:24:47.350079 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-03907c9e-633f-4478-a373-a058f96d22bf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:24:47.359092 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-03907c9e-633f-4478-a373-a058f96d22bf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:47.359574 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-03907c9e-633f-4478-a373-a058f96d22bf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:47.360350 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-03907c9e-633f-4478-a373-a058f96d22bf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:47.360771 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-03907c9e-633f-4478-a373-a058f96d22bf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:47.380387 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-03907c9e-633f-4478-a373-a058f96d22bf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Getting quotas for project 824cb65198bf417fbc4baeae349d358d. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:24:47.385620 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-03907c9e-633f-4478-a373-a058f96d22bf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Getting quotas for user e4b46dc825704fbc9cc2505805f22f94 and project 824cb65198bf417fbc4baeae349d358d. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:24:47.457336 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-03907c9e-633f-4478-a373-a058f96d22bf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Going to run 1 instances... {{(pid=117891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:24:47.460178 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-03907c9e-633f-4478-a373-a058f96d22bf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='db1dc1d6-5331-41d3-91a8-171dc6013f30',volume_size=None,volume_type=None)] {{(pid=117891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:24:47.625740 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-03907c9e-633f-4478-a373-a058f96d22bf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.783502 Jun 27 21:24:47.626797 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 478/926] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 27 21:24:46 2022] POST /compute/v2.1/servers => generated 403 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:24:47.638160 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6b2d462b-0fc6-4c4e-9c7d-70dfd23ec736 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:47.640134 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6b2d462b-0fc6-4c4e-9c7d-70dfd23ec736 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:47.697555 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-de57d04b-a418-4864-a12a-e849bb32074a req-a957ed3e-5e04-4526-b2d6-2ca2670aa3d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d342f76-2548-4bed-8f8e-1b722c8e61e3", "name": "network-vif-plugged", "status": "completed", "tag": "327711ca-a708-4b77-8455-a571c628332b"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:47.720517 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-de57d04b-a418-4864-a12a-e849bb32074a req-a957ed3e-5e04-4526-b2d6-2ca2670aa3d0 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:47.721226 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-de57d04b-a418-4864-a12a-e849bb32074a req-a957ed3e-5e04-4526-b2d6-2ca2670aa3d0 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:47.746805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-de57d04b-a418-4864-a12a-e849bb32074a req-a957ed3e-5e04-4526-b2d6-2ca2670aa3d0 service nova] Creating event network-vif-plugged:327711ca-a708-4b77-8455-a571c628332b for instance 3d342f76-2548-4bed-8f8e-1b722c8e61e3 on hv-cinder-84773 Jun 27 21:24:47.755357 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6b2d462b-0fc6-4c4e-9c7d-70dfd23ec736 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:47.766387 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6b2d462b-0fc6-4c4e-9c7d-70dfd23ec736 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453" status: 200 len: 1094 microversion: 2.1 time: 0.133263 Jun 27 21:24:47.768000 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 449/927] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:47 2022] GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 => generated 1094 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:47.774855 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-de57d04b-a418-4864-a12a-e849bb32074a req-a957ed3e-5e04-4526-b2d6-2ca2670aa3d0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081576 Jun 27 21:24:47.775478 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 479/928] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:24:47.778673 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-05921c1c-376a-4cee-8bdf-c1912f6c34a5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:47.784836 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-05921c1c-376a-4cee-8bdf-c1912f6c34a5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: b9c20f29-5815-4489-a5fc-7a5ee23b071c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:47.795240 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-05921c1c-376a-4cee-8bdf-c1912f6c34a5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:47.796100 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-05921c1c-376a-4cee-8bdf-c1912f6c34a5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:47.797192 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-05921c1c-376a-4cee-8bdf-c1912f6c34a5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:47.797713 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-05921c1c-376a-4cee-8bdf-c1912f6c34a5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:47.969199 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-05921c1c-376a-4cee-8bdf-c1912f6c34a5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:47.977688 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-05921c1c-376a-4cee-8bdf-c1912f6c34a5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c" status: 200 len: 1319 microversion: 2.1 time: 0.208148 Jun 27 21:24:47.978906 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 450/929] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:47 2022] GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:48.018847 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-92eb4ce8-372b-4047-9166-646026f71f04 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:48.019775 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-92eb4ce8-372b-4047-9166-646026f71f04 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:48.033145 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-92eb4ce8-372b-4047-9166-646026f71f04 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:48.033723 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-92eb4ce8-372b-4047-9166-646026f71f04 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:48.034612 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-92eb4ce8-372b-4047-9166-646026f71f04 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:48.035110 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-92eb4ce8-372b-4047-9166-646026f71f04 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:48.198912 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-92eb4ce8-372b-4047-9166-646026f71f04 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:48.206831 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-92eb4ce8-372b-4047-9166-646026f71f04 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1359 microversion: 2.1 time: 0.192817 Jun 27 21:24:48.207378 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 480/930] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:48 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:48.785105 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f11cd165-65a3-461e-963c-ebc708fff2ca tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:48.785808 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f11cd165-65a3-461e-963c-ebc708fff2ca tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:48.793357 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f11cd165-65a3-461e-963c-ebc708fff2ca tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:48.794159 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f11cd165-65a3-461e-963c-ebc708fff2ca tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:48.794928 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f11cd165-65a3-461e-963c-ebc708fff2ca tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:48.795423 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f11cd165-65a3-461e-963c-ebc708fff2ca tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:48.871746 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f11cd165-65a3-461e-963c-ebc708fff2ca tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:48.880050 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f11cd165-65a3-461e-963c-ebc708fff2ca tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453" status: 200 len: 1192 microversion: 2.1 time: 0.098985 Jun 27 21:24:48.880787 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 451/931] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:48 2022] GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 => generated 1192 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:48.994993 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-23ed7599-74c5-41ae-a9fc-edfaf6e28e1a tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:48.995619 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-23ed7599-74c5-41ae-a9fc-edfaf6e28e1a tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: b9c20f29-5815-4489-a5fc-7a5ee23b071c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:49.002588 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-23ed7599-74c5-41ae-a9fc-edfaf6e28e1a tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:49.003032 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-23ed7599-74c5-41ae-a9fc-edfaf6e28e1a tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:49.003801 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-23ed7599-74c5-41ae-a9fc-edfaf6e28e1a tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:49.004234 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-23ed7599-74c5-41ae-a9fc-edfaf6e28e1a tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:49.141084 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-23ed7599-74c5-41ae-a9fc-edfaf6e28e1a tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:49.149526 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-23ed7599-74c5-41ae-a9fc-edfaf6e28e1a tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c" status: 200 len: 1319 microversion: 2.1 time: 0.158599 Jun 27 21:24:49.150094 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 481/932] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:48 2022] GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:49.223966 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d47ab1ba-82f5-40ec-a3d4-eed8fe765c48 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:49.224584 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d47ab1ba-82f5-40ec-a3d4-eed8fe765c48 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:49.231311 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d47ab1ba-82f5-40ec-a3d4-eed8fe765c48 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:49.231765 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d47ab1ba-82f5-40ec-a3d4-eed8fe765c48 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:49.232569 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d47ab1ba-82f5-40ec-a3d4-eed8fe765c48 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:49.232994 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d47ab1ba-82f5-40ec-a3d4-eed8fe765c48 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:49.384415 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d47ab1ba-82f5-40ec-a3d4-eed8fe765c48 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:49.392383 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d47ab1ba-82f5-40ec-a3d4-eed8fe765c48 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1359 microversion: 2.1 time: 0.172492 Jun 27 21:24:49.392972 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 452/933] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:49 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:49.795113 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-0454a319-d761-4ddb-916a-ee37aff88b5e req-be0ae609-fcbf-4637-99db-b87ea24953d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c20f29-5815-4489-a5fc-7a5ee23b071c", "name": "network-vif-plugged", "status": "completed", "tag": "ebca0722-12bd-4da8-bd7f-37c2b6cdd9f3"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:49.803565 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-0454a319-d761-4ddb-916a-ee37aff88b5e req-be0ae609-fcbf-4637-99db-b87ea24953d5 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:49.803989 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-0454a319-d761-4ddb-916a-ee37aff88b5e req-be0ae609-fcbf-4637-99db-b87ea24953d5 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:49.815388 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-0454a319-d761-4ddb-916a-ee37aff88b5e req-be0ae609-fcbf-4637-99db-b87ea24953d5 service nova] Creating event network-vif-plugged:ebca0722-12bd-4da8-bd7f-37c2b6cdd9f3 for instance b9c20f29-5815-4489-a5fc-7a5ee23b071c on hv-cinder-84773 Jun 27 21:24:49.820548 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-0454a319-d761-4ddb-916a-ee37aff88b5e req-be0ae609-fcbf-4637-99db-b87ea24953d5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029110 Jun 27 21:24:49.821179 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 482/934] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:24:49.898959 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5e951329-6c5d-4a93-ac38-89aa22ff9066 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:49.899765 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5e951329-6c5d-4a93-ac38-89aa22ff9066 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:49.907146 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5e951329-6c5d-4a93-ac38-89aa22ff9066 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:49.907578 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5e951329-6c5d-4a93-ac38-89aa22ff9066 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:49.908350 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5e951329-6c5d-4a93-ac38-89aa22ff9066 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:49.908796 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5e951329-6c5d-4a93-ac38-89aa22ff9066 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:49.981822 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5e951329-6c5d-4a93-ac38-89aa22ff9066 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:49.990681 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5e951329-6c5d-4a93-ac38-89aa22ff9066 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453" status: 200 len: 1210 microversion: 2.1 time: 0.095771 Jun 27 21:24:49.991229 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 453/935] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:49 2022] GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:50.167950 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-07d99562-8b3d-451f-bfc6-8c89704a76a4 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:50.168615 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-07d99562-8b3d-451f-bfc6-8c89704a76a4 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: b9c20f29-5815-4489-a5fc-7a5ee23b071c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:50.175213 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-07d99562-8b3d-451f-bfc6-8c89704a76a4 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:50.175655 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-07d99562-8b3d-451f-bfc6-8c89704a76a4 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:50.176404 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-07d99562-8b3d-451f-bfc6-8c89704a76a4 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:50.176836 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-07d99562-8b3d-451f-bfc6-8c89704a76a4 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:50.311986 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-07d99562-8b3d-451f-bfc6-8c89704a76a4 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:50.320079 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-07d99562-8b3d-451f-bfc6-8c89704a76a4 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c" status: 200 len: 1319 microversion: 2.1 time: 0.156945 Jun 27 21:24:50.320630 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 483/936] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:50 2022] GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:50.409418 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-476b3246-b1db-4cd5-9e85-1b846d1de68c tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:50.409996 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-476b3246-b1db-4cd5-9e85-1b846d1de68c tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:50.417815 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-476b3246-b1db-4cd5-9e85-1b846d1de68c tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:50.418487 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-476b3246-b1db-4cd5-9e85-1b846d1de68c tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:50.419246 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-476b3246-b1db-4cd5-9e85-1b846d1de68c tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:50.419704 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-476b3246-b1db-4cd5-9e85-1b846d1de68c tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:50.671633 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-476b3246-b1db-4cd5-9e85-1b846d1de68c tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:50.680722 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-476b3246-b1db-4cd5-9e85-1b846d1de68c tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1550 microversion: 2.1 time: 0.275100 Jun 27 21:24:50.681319 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 454/937] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:50 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1550 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:24:50.697664 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0fdb2056-6c75-48e2-a096-12b326577158 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:50.698292 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0fdb2056-6c75-48e2-a096-12b326577158 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:50.704651 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0fdb2056-6c75-48e2-a096-12b326577158 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:50.705502 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0fdb2056-6c75-48e2-a096-12b326577158 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:50.706402 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0fdb2056-6c75-48e2-a096-12b326577158 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:50.706717 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0fdb2056-6c75-48e2-a096-12b326577158 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:50.727067 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=100 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:50.874026 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0fdb2056-6c75-48e2-a096-12b326577158 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:50.882550 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0fdb2056-6c75-48e2-a096-12b326577158 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1550 microversion: 2.1 time: 0.188839 Jun 27 21:24:50.883263 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 484/938] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:50 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1550 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:50.899367 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4a0c55f6-4b3c-45cd-ba73-f63123ed7748 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:50.902950 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4a0c55f6-4b3c-45cd-ba73-f63123ed7748 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:50.903729 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4a0c55f6-4b3c-45cd-ba73-f63123ed7748 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Searching by: {'deleted': False, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c'} {{(pid=117889) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 27 21:24:50.910920 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a0c55f6-4b3c-45cd-ba73-f63123ed7748 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:50.911461 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a0c55f6-4b3c-45cd-ba73-f63123ed7748 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:50.912252 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a0c55f6-4b3c-45cd-ba73-f63123ed7748 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:50.912667 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a0c55f6-4b3c-45cd-ba73-f63123ed7748 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:51.009190 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-68040932-22af-4140-81c4-3d3ad00ebe0f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:51.010066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-68040932-22af-4140-81c4-3d3ad00ebe0f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:51.011985 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.multi_cell_list [None req-4a0c55f6-4b3c-45cd-ba73-f63123ed7748 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117889) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 27 21:24:51.017395 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-68040932-22af-4140-81c4-3d3ad00ebe0f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:51.017811 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-68040932-22af-4140-81c4-3d3ad00ebe0f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:51.018548 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-68040932-22af-4140-81c4-3d3ad00ebe0f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:51.018974 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-68040932-22af-4140-81c4-3d3ad00ebe0f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:51.121003 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4a0c55f6-4b3c-45cd-ba73-f63123ed7748 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.225713 Jun 27 21:24:51.122507 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 455/939] 10.222.0.13 () {58 vars in 1124 bytes} [Mon Jun 27 21:24:50 2022] GET /compute/v2.1/servers => generated 343 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:24:51.136829 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-66ed9766-48a6-430d-9bc9-b789ab109937 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:51.137491 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-66ed9766-48a6-430d-9bc9-b789ab109937 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:51.144544 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66ed9766-48a6-430d-9bc9-b789ab109937 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:51.145386 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66ed9766-48a6-430d-9bc9-b789ab109937 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:51.147088 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66ed9766-48a6-430d-9bc9-b789ab109937 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:51.148100 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66ed9766-48a6-430d-9bc9-b789ab109937 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:51.191624 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-68040932-22af-4140-81c4-3d3ad00ebe0f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:51.201345 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-68040932-22af-4140-81c4-3d3ad00ebe0f tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453" status: 200 len: 1275 microversion: 2.1 time: 0.196592 Jun 27 21:24:51.212947 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 485/940] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:51 2022] GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 => generated 1275 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:24:51.337891 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3428e119-88c9-4515-b602-a24a54b43dca tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:51.338646 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3428e119-88c9-4515-b602-a24a54b43dca tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: b9c20f29-5815-4489-a5fc-7a5ee23b071c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:51.345361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3428e119-88c9-4515-b602-a24a54b43dca tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:51.345809 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3428e119-88c9-4515-b602-a24a54b43dca tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:51.346571 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3428e119-88c9-4515-b602-a24a54b43dca tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:51.346999 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3428e119-88c9-4515-b602-a24a54b43dca tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:51.378777 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-66ed9766-48a6-430d-9bc9-b789ab109937 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:51.387099 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-66ed9766-48a6-430d-9bc9-b789ab109937 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1550 microversion: 2.1 time: 0.257181 Jun 27 21:24:51.408346 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 456/941] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:51 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1550 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:24:51.504663 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3428e119-88c9-4515-b602-a24a54b43dca tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:51.518419 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3428e119-88c9-4515-b602-a24a54b43dca tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c" status: 200 len: 1319 microversion: 2.1 time: 0.184576 Jun 27 21:24:51.528417 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 486/942] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:51 2022] GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:51.716381 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-9eabec2b-10b7-4c15-b745-00503c98943f req-99cddff5-fda6-47f4-b812-e5d205293333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a7e5b75-82ca-47af-a6cd-41fe4b7b3453", "tag": "fe53f861-c6c2-4087-a223-4e44a93bac65"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:51.726164 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-9eabec2b-10b7-4c15-b745-00503c98943f req-99cddff5-fda6-47f4-b812-e5d205293333 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:51.726674 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-9eabec2b-10b7-4c15-b745-00503c98943f req-99cddff5-fda6-47f4-b812-e5d205293333 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:51.917705 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-9eabec2b-10b7-4c15-b745-00503c98943f req-99cddff5-fda6-47f4-b812-e5d205293333 service nova] Creating event network-changed:fe53f861-c6c2-4087-a223-4e44a93bac65 for instance 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 on hv-cinder-84773 Jun 27 21:24:51.922811 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-9eabec2b-10b7-4c15-b745-00503c98943f req-99cddff5-fda6-47f4-b812-e5d205293333 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210057 Jun 27 21:24:51.923431 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 457/943] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:24:52.219996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3035d009-f9b1-4741-8675-9238d286d442 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:52.220752 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3035d009-f9b1-4741-8675-9238d286d442 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:52.227969 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3035d009-f9b1-4741-8675-9238d286d442 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:52.228416 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3035d009-f9b1-4741-8675-9238d286d442 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:52.229198 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3035d009-f9b1-4741-8675-9238d286d442 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:52.229622 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3035d009-f9b1-4741-8675-9238d286d442 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:52.377559 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3035d009-f9b1-4741-8675-9238d286d442 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:52.386265 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3035d009-f9b1-4741-8675-9238d286d442 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453" status: 200 len: 1263 microversion: 2.1 time: 0.170116 Jun 27 21:24:52.386953 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 487/944] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:52 2022] GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 => generated 1263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:52.538988 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c50ae8b4-49e6-4426-bad3-d4bf364a3ca3 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:52.540069 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c50ae8b4-49e6-4426-bad3-d4bf364a3ca3 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: b9c20f29-5815-4489-a5fc-7a5ee23b071c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:52.550300 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c50ae8b4-49e6-4426-bad3-d4bf364a3ca3 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:52.550857 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c50ae8b4-49e6-4426-bad3-d4bf364a3ca3 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:52.552048 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c50ae8b4-49e6-4426-bad3-d4bf364a3ca3 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:52.552671 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c50ae8b4-49e6-4426-bad3-d4bf364a3ca3 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:52.725727 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c50ae8b4-49e6-4426-bad3-d4bf364a3ca3 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:52.733808 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c50ae8b4-49e6-4426-bad3-d4bf364a3ca3 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c" status: 200 len: 1507 microversion: 2.1 time: 0.201539 Jun 27 21:24:52.734489 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 458/945] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:52 2022] GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c => generated 1507 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:53.056691 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1dbca584-48aa-46ed-81f6-0c778d91219e tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c06dc492-ca54-46d7-bac6-298ed58ea1b9"}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:53.057874 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1dbca584-48aa-46ed-81f6-0c778d91219e tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:53.064325 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1dbca584-48aa-46ed-81f6-0c778d91219e tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:53.064778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1dbca584-48aa-46ed-81f6-0c778d91219e tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:53.065709 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1dbca584-48aa-46ed-81f6-0c778d91219e tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:53.066156 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1dbca584-48aa-46ed-81f6-0c778d91219e tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:53.348221 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1dbca584-48aa-46ed-81f6-0c778d91219e tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "POST /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295416 Jun 27 21:24:53.349676 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 488/946] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 27 21:24:53 2022] POST /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:24:53.403934 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bda411f7-527c-46c1-9a66-9c6878e5de4b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:53.404543 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bda411f7-527c-46c1-9a66-9c6878e5de4b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:53.411670 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bda411f7-527c-46c1-9a66-9c6878e5de4b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:53.412097 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bda411f7-527c-46c1-9a66-9c6878e5de4b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:53.412860 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bda411f7-527c-46c1-9a66-9c6878e5de4b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:53.413328 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bda411f7-527c-46c1-9a66-9c6878e5de4b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:53.646631 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bda411f7-527c-46c1-9a66-9c6878e5de4b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:53.655042 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bda411f7-527c-46c1-9a66-9c6878e5de4b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453" status: 200 len: 1263 microversion: 2.1 time: 0.255156 Jun 27 21:24:53.655706 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 459/947] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:53 2022] GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 => generated 1263 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:54.680272 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-340dc4db-9d74-4e43-aac4-e24496c96de4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:54.680946 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-340dc4db-9d74-4e43-aac4-e24496c96de4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:54.687897 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-340dc4db-9d74-4e43-aac4-e24496c96de4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:54.688340 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-340dc4db-9d74-4e43-aac4-e24496c96de4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:54.689258 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-340dc4db-9d74-4e43-aac4-e24496c96de4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:54.689744 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-340dc4db-9d74-4e43-aac4-e24496c96de4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:54.845139 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-340dc4db-9d74-4e43-aac4-e24496c96de4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:54.854535 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-340dc4db-9d74-4e43-aac4-e24496c96de4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453" status: 200 len: 1263 microversion: 2.1 time: 0.181673 Jun 27 21:24:54.855128 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 489/948] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:54 2022] GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 => generated 1263 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:55.874712 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-21954dbd-8826-4e72-8910-bdec36643322 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:55.875475 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-21954dbd-8826-4e72-8910-bdec36643322 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:55.885004 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-21954dbd-8826-4e72-8910-bdec36643322 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:55.885454 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-21954dbd-8826-4e72-8910-bdec36643322 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:55.886223 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-21954dbd-8826-4e72-8910-bdec36643322 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:55.886655 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-21954dbd-8826-4e72-8910-bdec36643322 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:56.032153 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-21954dbd-8826-4e72-8910-bdec36643322 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:56.040494 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-21954dbd-8826-4e72-8910-bdec36643322 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453" status: 200 len: 1263 microversion: 2.1 time: 0.172563 Jun 27 21:24:56.041154 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 460/949] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:55 2022] GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 => generated 1263 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:57.059265 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-27241c62-a486-482d-bccb-8fa78283e057 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:57.059876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-27241c62-a486-482d-bccb-8fa78283e057 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:57.063491 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:57.067595 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-27241c62-a486-482d-bccb-8fa78283e057 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:57.068034 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-27241c62-a486-482d-bccb-8fa78283e057 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:57.068812 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-27241c62-a486-482d-bccb-8fa78283e057 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:57.069282 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-27241c62-a486-482d-bccb-8fa78283e057 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:57.219018 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-27241c62-a486-482d-bccb-8fa78283e057 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:57.226653 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-27241c62-a486-482d-bccb-8fa78283e057 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453" status: 200 len: 1263 microversion: 2.1 time: 0.171898 Jun 27 21:24:57.227212 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 490/950] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:57 2022] GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:58.244219 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e9f5cf0e-3058-4387-ac8e-e5d3bae6ff04 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:58.244827 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e9f5cf0e-3058-4387-ac8e-e5d3bae6ff04 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:58.247117 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=10 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:58.252903 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e9f5cf0e-3058-4387-ac8e-e5d3bae6ff04 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:58.253347 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e9f5cf0e-3058-4387-ac8e-e5d3bae6ff04 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:58.254116 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e9f5cf0e-3058-4387-ac8e-e5d3bae6ff04 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:58.254547 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e9f5cf0e-3058-4387-ac8e-e5d3bae6ff04 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:58.405666 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e9f5cf0e-3058-4387-ac8e-e5d3bae6ff04 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:58.413393 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e9f5cf0e-3058-4387-ac8e-e5d3bae6ff04 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453" status: 200 len: 1263 microversion: 2.1 time: 0.173326 Jun 27 21:24:58.413989 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 461/951] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:58 2022] GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 => generated 1263 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:59.431154 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3c1bbf82-f657-46dd-a8e3-25283bcf3ded tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:59.431736 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3c1bbf82-f657-46dd-a8e3-25283bcf3ded tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:59.433640 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=4 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:59.434314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=18 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:59.441536 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3c1bbf82-f657-46dd-a8e3-25283bcf3ded tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:59.441984 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3c1bbf82-f657-46dd-a8e3-25283bcf3ded tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:59.442747 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3c1bbf82-f657-46dd-a8e3-25283bcf3ded tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:59.443191 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3c1bbf82-f657-46dd-a8e3-25283bcf3ded tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:59.586076 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3c1bbf82-f657-46dd-a8e3-25283bcf3ded tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:59.594344 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3c1bbf82-f657-46dd-a8e3-25283bcf3ded tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453" status: 200 len: 1263 microversion: 2.1 time: 0.166941 Jun 27 21:24:59.594935 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 491/952] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:59 2022] GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 => generated 1263 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:00.612968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-52256076-8cd0-4dcc-bd31-884a73427190 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:00.613572 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-52256076-8cd0-4dcc-bd31-884a73427190 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:00.616296 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:25:00.622221 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-52256076-8cd0-4dcc-bd31-884a73427190 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:00.622677 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-52256076-8cd0-4dcc-bd31-884a73427190 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:00.623438 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-52256076-8cd0-4dcc-bd31-884a73427190 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:00.623859 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-52256076-8cd0-4dcc-bd31-884a73427190 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:00.762579 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-52256076-8cd0-4dcc-bd31-884a73427190 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:00.772002 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-52256076-8cd0-4dcc-bd31-884a73427190 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453" status: 200 len: 1263 microversion: 2.1 time: 0.164218 Jun 27 21:25:00.772599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 462/953] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:00 2022] GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:01.011831 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-65ad13a9-8b17-4fdc-a512-f5bfe42176d0 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:01.012444 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-65ad13a9-8b17-4fdc-a512-f5bfe42176d0 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:01.019246 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-65ad13a9-8b17-4fdc-a512-f5bfe42176d0 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:01.020224 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-65ad13a9-8b17-4fdc-a512-f5bfe42176d0 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:01.020453 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-65ad13a9-8b17-4fdc-a512-f5bfe42176d0 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:01.020887 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-65ad13a9-8b17-4fdc-a512-f5bfe42176d0 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:01.165502 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-65ad13a9-8b17-4fdc-a512-f5bfe42176d0 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:01.174055 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-65ad13a9-8b17-4fdc-a512-f5bfe42176d0 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1596 microversion: 2.1 time: 0.168413 Jun 27 21:25:01.174659 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 492/954] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:01 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1596 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:01.790801 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-222b2453-9f6b-406d-8792-c8987a152535 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:01.791728 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-222b2453-9f6b-406d-8792-c8987a152535 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:01.793759 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:25:01.806118 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-222b2453-9f6b-406d-8792-c8987a152535 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:01.806969 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-222b2453-9f6b-406d-8792-c8987a152535 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:01.807948 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-222b2453-9f6b-406d-8792-c8987a152535 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:01.808544 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-222b2453-9f6b-406d-8792-c8987a152535 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:02.076609 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-222b2453-9f6b-406d-8792-c8987a152535 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:02.085042 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-222b2453-9f6b-406d-8792-c8987a152535 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453" status: 200 len: 1263 microversion: 2.1 time: 0.299023 Jun 27 21:25:02.085991 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 463/955] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:01 2022] GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 => generated 1263 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:03.103020 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3bafe425-3623-424f-890c-f321a68f9de3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:03.103662 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3bafe425-3623-424f-890c-f321a68f9de3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:03.110604 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3bafe425-3623-424f-890c-f321a68f9de3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:03.111056 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3bafe425-3623-424f-890c-f321a68f9de3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:03.112139 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3bafe425-3623-424f-890c-f321a68f9de3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:03.112958 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3bafe425-3623-424f-890c-f321a68f9de3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:03.261032 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3bafe425-3623-424f-890c-f321a68f9de3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:03.269143 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3bafe425-3623-424f-890c-f321a68f9de3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453" status: 200 len: 1263 microversion: 2.1 time: 0.169956 Jun 27 21:25:03.271782 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 493/956] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:03 2022] GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 => generated 1263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:03.369973 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-fdc7edd3-b679-4044-92a2-f600eb2d8355 req-405fb270-f642-4a7e-914f-1bc903fc636f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d342f76-2548-4bed-8f8e-1b722c8e61e3", "tag": "327711ca-a708-4b77-8455-a571c628332b"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:25:03.379078 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-fdc7edd3-b679-4044-92a2-f600eb2d8355 req-405fb270-f642-4a7e-914f-1bc903fc636f service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:03.379687 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-fdc7edd3-b679-4044-92a2-f600eb2d8355 req-405fb270-f642-4a7e-914f-1bc903fc636f service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:03.391817 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-fdc7edd3-b679-4044-92a2-f600eb2d8355 req-405fb270-f642-4a7e-914f-1bc903fc636f service nova] Creating event network-changed:327711ca-a708-4b77-8455-a571c628332b for instance 3d342f76-2548-4bed-8f8e-1b722c8e61e3 on hv-cinder-84773 Jun 27 21:25:03.397401 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-fdc7edd3-b679-4044-92a2-f600eb2d8355 req-405fb270-f642-4a7e-914f-1bc903fc636f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031500 Jun 27 21:25:03.398595 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 464/957] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:25:03.651541 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-dbf8123e-71ca-4568-b838-ef1db8f2ff15 req-be9839a6-53b2-4db7-8862-ea54ecfe769a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a7e5b75-82ca-47af-a6cd-41fe4b7b3453", "name": "network-vif-plugged", "status": "completed", "tag": "fe53f861-c6c2-4087-a223-4e44a93bac65"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:25:03.667971 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-dbf8123e-71ca-4568-b838-ef1db8f2ff15 req-be9839a6-53b2-4db7-8862-ea54ecfe769a service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:03.674737 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-dbf8123e-71ca-4568-b838-ef1db8f2ff15 req-be9839a6-53b2-4db7-8862-ea54ecfe769a service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:03.706386 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-dbf8123e-71ca-4568-b838-ef1db8f2ff15 req-be9839a6-53b2-4db7-8862-ea54ecfe769a service nova] Creating event network-vif-plugged:fe53f861-c6c2-4087-a223-4e44a93bac65 for instance 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 on hv-cinder-84773 Jun 27 21:25:03.714154 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-dbf8123e-71ca-4568-b838-ef1db8f2ff15 req-be9839a6-53b2-4db7-8862-ea54ecfe769a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068116 Jun 27 21:25:03.715085 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 494/958] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:25:04.288951 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-264b55cb-2c02-4870-a996-e7f861c19122 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:04.289646 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-264b55cb-2c02-4870-a996-e7f861c19122 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:04.296731 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-264b55cb-2c02-4870-a996-e7f861c19122 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:04.296877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-264b55cb-2c02-4870-a996-e7f861c19122 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:04.297624 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-264b55cb-2c02-4870-a996-e7f861c19122 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:04.298047 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-264b55cb-2c02-4870-a996-e7f861c19122 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:04.471533 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-264b55cb-2c02-4870-a996-e7f861c19122 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:04.483964 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-264b55cb-2c02-4870-a996-e7f861c19122 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453" status: 200 len: 1263 microversion: 2.1 time: 0.199575 Jun 27 21:25:04.485157 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 465/959] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:04 2022] GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 => generated 1263 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:04.539436 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9f86f04a-23ec-42d2-a271-38eef92dcd2d tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2068254880"}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:25:04.539986 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9f86f04a-23ec-42d2-a271-38eef92dcd2d tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:04.546920 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9f86f04a-23ec-42d2-a271-38eef92dcd2d tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:04.547501 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9f86f04a-23ec-42d2-a271-38eef92dcd2d tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:04.548378 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9f86f04a-23ec-42d2-a271-38eef92dcd2d tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:04.548815 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9f86f04a-23ec-42d2-a271-38eef92dcd2d tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:04.696344 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.network.security_group_api [None req-9f86f04a-23ec-42d2-a271-38eef92dcd2d tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Adding security group 0a5e80ec-59fc-422d-a9fa-b10f43bcde05 to port 327711ca-a708-4b77-8455-a571c628332b Jun 27 21:25:05.068480 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9f86f04a-23ec-42d2-a271-38eef92dcd2d tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "POST /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3/action" status: 202 len: 0 microversion: 2.1 time: 0.533629 Jun 27 21:25:05.069120 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 495/960] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 27 21:25:04 2022] POST /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:25:05.077996 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-381f0614-6fbd-4f71-b8e4-a6b9ef85c070 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:05.078548 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-381f0614-6fbd-4f71-b8e4-a6b9ef85c070 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:05.082876 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-6ec7ad8f-3f16-4904-a449-33a54881a12e req-344e8c44-4f0d-4546-8077-02bae8be804e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d342f76-2548-4bed-8f8e-1b722c8e61e3", "tag": "327711ca-a708-4b77-8455-a571c628332b"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:25:05.087090 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-381f0614-6fbd-4f71-b8e4-a6b9ef85c070 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:05.087881 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-381f0614-6fbd-4f71-b8e4-a6b9ef85c070 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:05.088882 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-381f0614-6fbd-4f71-b8e4-a6b9ef85c070 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:05.089752 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-381f0614-6fbd-4f71-b8e4-a6b9ef85c070 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:05.094517 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:25:05.094710 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-6ec7ad8f-3f16-4904-a449-33a54881a12e req-344e8c44-4f0d-4546-8077-02bae8be804e service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:05.095140 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-6ec7ad8f-3f16-4904-a449-33a54881a12e req-344e8c44-4f0d-4546-8077-02bae8be804e service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:05.115481 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-6ec7ad8f-3f16-4904-a449-33a54881a12e req-344e8c44-4f0d-4546-8077-02bae8be804e service nova] Creating event network-changed:327711ca-a708-4b77-8455-a571c628332b for instance 3d342f76-2548-4bed-8f8e-1b722c8e61e3 on hv-cinder-84773 Jun 27 21:25:05.120758 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-6ec7ad8f-3f16-4904-a449-33a54881a12e req-344e8c44-4f0d-4546-8077-02bae8be804e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045134 Jun 27 21:25:05.121892 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 496/961] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:25:05.263594 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-381f0614-6fbd-4f71-b8e4-a6b9ef85c070 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:05.272178 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-381f0614-6fbd-4f71-b8e4-a6b9ef85c070 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1762 microversion: 2.1 time: 0.198345 Jun 27 21:25:05.272726 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 466/962] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:05 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1762 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:05.503066 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-51468913-d63e-408e-b44c-572edf73663c tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:05.503745 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-51468913-d63e-408e-b44c-572edf73663c tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:05.511004 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-51468913-d63e-408e-b44c-572edf73663c tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:05.511346 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-51468913-d63e-408e-b44c-572edf73663c tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:05.512121 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-51468913-d63e-408e-b44c-572edf73663c tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:05.512554 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-51468913-d63e-408e-b44c-572edf73663c tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:05.674452 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-51468913-d63e-408e-b44c-572edf73663c tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:05.686104 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-51468913-d63e-408e-b44c-572edf73663c tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453" status: 200 len: 1450 microversion: 2.1 time: 0.187662 Jun 27 21:25:05.687193 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 497/963] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:05 2022] GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 => generated 1450 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:05.703382 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2ece9757-8c16-4f89-8e17-2ac6112c94fa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:05.704023 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2ece9757-8c16-4f89-8e17-2ac6112c94fa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:05.711627 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2ece9757-8c16-4f89-8e17-2ac6112c94fa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:05.712069 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2ece9757-8c16-4f89-8e17-2ac6112c94fa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:05.712840 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2ece9757-8c16-4f89-8e17-2ac6112c94fa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:05.714904 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2ece9757-8c16-4f89-8e17-2ac6112c94fa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:05.907232 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2ece9757-8c16-4f89-8e17-2ac6112c94fa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:05.915575 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2ece9757-8c16-4f89-8e17-2ac6112c94fa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453" status: 200 len: 1450 microversion: 2.1 time: 0.216017 Jun 27 21:25:05.916311 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 467/964] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:05 2022] GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 => generated 1450 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:07.577278 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-f2c61cb3-f355-4d7f-a409-5e276df24913 req-80e942dc-7de5-4a6f-ab8b-23d62983ef31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a7e5b75-82ca-47af-a6cd-41fe4b7b3453", "tag": "fe53f861-c6c2-4087-a223-4e44a93bac65"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:25:07.586949 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-f2c61cb3-f355-4d7f-a409-5e276df24913 req-80e942dc-7de5-4a6f-ab8b-23d62983ef31 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:07.587389 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-f2c61cb3-f355-4d7f-a409-5e276df24913 req-80e942dc-7de5-4a6f-ab8b-23d62983ef31 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:07.598710 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-f2c61cb3-f355-4d7f-a409-5e276df24913 req-80e942dc-7de5-4a6f-ab8b-23d62983ef31 service nova] Creating event network-changed:fe53f861-c6c2-4087-a223-4e44a93bac65 for instance 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 on hv-cinder-84773 Jun 27 21:25:07.603795 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-f2c61cb3-f355-4d7f-a409-5e276df24913 req-80e942dc-7de5-4a6f-ab8b-23d62983ef31 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030305 Jun 27 21:25:07.604372 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 498/965] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:25:08.036335 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7167909c-ba81-4c0c-9b7b-7f68d1b6ef34 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d155f4df-38fa-4fc7-8871-bd22ae131602", "device": "/dev/sdb"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:25:08.038535 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7167909c-ba81-4c0c-9b7b-7f68d1b6ef34 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: b9c20f29-5815-4489-a5fc-7a5ee23b071c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:08.045451 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7167909c-ba81-4c0c-9b7b-7f68d1b6ef34 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:08.046200 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7167909c-ba81-4c0c-9b7b-7f68d1b6ef34 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:08.047144 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7167909c-ba81-4c0c-9b7b-7f68d1b6ef34 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:08.047729 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7167909c-ba81-4c0c-9b7b-7f68d1b6ef34 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:08.333150 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7167909c-ba81-4c0c-9b7b-7f68d1b6ef34 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "POST /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300635 Jun 27 21:25:08.333771 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 468/966] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 27 21:25:08 2022] POST /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:25:32.180133 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4eb62108-6653-4216-b42e-12d17c2881db tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:32.181026 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4eb62108-6653-4216-b42e-12d17c2881db tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: b9c20f29-5815-4489-a5fc-7a5ee23b071c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:32.184115 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=16 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:25:32.184754 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:25:32.193552 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4eb62108-6653-4216-b42e-12d17c2881db tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:32.194204 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4eb62108-6653-4216-b42e-12d17c2881db tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:32.195329 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4eb62108-6653-4216-b42e-12d17c2881db tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:32.196000 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4eb62108-6653-4216-b42e-12d17c2881db tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:32.283907 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-4eb62108-6653-4216-b42e-12d17c2881db tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lazy-loading 'services' on Instance uuid b9c20f29-5815-4489-a5fc-7a5ee23b071c {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:25:32.372360 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4eb62108-6653-4216-b42e-12d17c2881db tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c/os-volume_attachments/d155f4df-38fa-4fc7-8871-bd22ae131602" status: 202 len: 0 microversion: 2.1 time: 0.199032 Jun 27 21:25:32.372997 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 499/967] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 27 21:25:32 2022] DELETE /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c/os-volume_attachments/d155f4df-38fa-4fc7-8871-bd22ae131602 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:25:33.494128 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=13 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:25:33.494962 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:25:33.499339 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-dc4480e6-47c9-4ba4-a55b-c02c0ec6e5ca tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:33.499938 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-dc4480e6-47c9-4ba4-a55b-c02c0ec6e5ca tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: b9c20f29-5815-4489-a5fc-7a5ee23b071c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:33.507988 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dc4480e6-47c9-4ba4-a55b-c02c0ec6e5ca tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:33.508366 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dc4480e6-47c9-4ba4-a55b-c02c0ec6e5ca tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:33.509230 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dc4480e6-47c9-4ba4-a55b-c02c0ec6e5ca tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:33.509663 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dc4480e6-47c9-4ba4-a55b-c02c0ec6e5ca tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:33.536098 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-dc4480e6-47c9-4ba4-a55b-c02c0ec6e5ca tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: b9c20f29-5815-4489-a5fc-7a5ee23b071c] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:25:33.616992 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-dc4480e6-47c9-4ba4-a55b-c02c0ec6e5ca tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c" status: 204 len: 0 microversion: 2.1 time: 0.124109 Jun 27 21:25:33.617910 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 469/968] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:25:33 2022] DELETE /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:25:33.629113 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-187f5988-800b-4813-9bb1-90a98aefa7d1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:33.629797 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-187f5988-800b-4813-9bb1-90a98aefa7d1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: b9c20f29-5815-4489-a5fc-7a5ee23b071c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:33.636215 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-187f5988-800b-4813-9bb1-90a98aefa7d1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:33.636650 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-187f5988-800b-4813-9bb1-90a98aefa7d1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:33.637489 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-187f5988-800b-4813-9bb1-90a98aefa7d1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:33.637915 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-187f5988-800b-4813-9bb1-90a98aefa7d1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:33.796193 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-187f5988-800b-4813-9bb1-90a98aefa7d1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:33.804574 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-187f5988-800b-4813-9bb1-90a98aefa7d1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c" status: 200 len: 1513 microversion: 2.1 time: 0.181979 Jun 27 21:25:33.805183 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 500/969] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:33 2022] GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:34.826753 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-df472fc3-8b5e-49f0-8296-25ff9b75ad69 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:34.827572 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-df472fc3-8b5e-49f0-8296-25ff9b75ad69 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: b9c20f29-5815-4489-a5fc-7a5ee23b071c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:34.838522 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-df472fc3-8b5e-49f0-8296-25ff9b75ad69 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:34.839158 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-df472fc3-8b5e-49f0-8296-25ff9b75ad69 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:34.840173 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-df472fc3-8b5e-49f0-8296-25ff9b75ad69 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:34.840764 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-df472fc3-8b5e-49f0-8296-25ff9b75ad69 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:34.999322 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-df472fc3-8b5e-49f0-8296-25ff9b75ad69 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:35.011148 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-df472fc3-8b5e-49f0-8296-25ff9b75ad69 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c" status: 200 len: 1513 microversion: 2.1 time: 0.191181 Jun 27 21:25:35.011883 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 470/970] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:34 2022] GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c => generated 1513 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:35.969050 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-260e9e02-7441-4721-a0d7-b7de6b17bc21 req-45b9da07-e03b-4f85-80ac-bde47568b986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c20f29-5815-4489-a5fc-7a5ee23b071c", "name": "network-vif-deleted", "tag": "ebca0722-12bd-4da8-bd7f-37c2b6cdd9f3"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:25:35.979866 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-260e9e02-7441-4721-a0d7-b7de6b17bc21 req-45b9da07-e03b-4f85-80ac-bde47568b986 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:35.980319 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-260e9e02-7441-4721-a0d7-b7de6b17bc21 req-45b9da07-e03b-4f85-80ac-bde47568b986 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:35.994157 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-260e9e02-7441-4721-a0d7-b7de6b17bc21 req-45b9da07-e03b-4f85-80ac-bde47568b986 service nova] Creating event network-vif-deleted:ebca0722-12bd-4da8-bd7f-37c2b6cdd9f3 for instance b9c20f29-5815-4489-a5fc-7a5ee23b071c on hv-cinder-84773 Jun 27 21:25:35.999354 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-260e9e02-7441-4721-a0d7-b7de6b17bc21 req-45b9da07-e03b-4f85-80ac-bde47568b986 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034152 Jun 27 21:25:35.999966 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 501/971] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:25:36.030869 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-78ab1252-2f07-484d-b4c3-d48b08de51a4 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:36.031919 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-78ab1252-2f07-484d-b4c3-d48b08de51a4 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: b9c20f29-5815-4489-a5fc-7a5ee23b071c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:36.041471 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-78ab1252-2f07-484d-b4c3-d48b08de51a4 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:36.042008 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-78ab1252-2f07-484d-b4c3-d48b08de51a4 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:36.042783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-78ab1252-2f07-484d-b4c3-d48b08de51a4 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:36.043252 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-78ab1252-2f07-484d-b4c3-d48b08de51a4 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:36.113884 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-78ab1252-2f07-484d-b4c3-d48b08de51a4 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:36.121800 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-78ab1252-2f07-484d-b4c3-d48b08de51a4 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c" status: 200 len: 1304 microversion: 2.1 time: 0.095620 Jun 27 21:25:36.129523 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 471/972] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:36 2022] GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:37.140363 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9dc480ff-1335-41a2-bc04-d4c79d6b67ad tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:37.141097 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9dc480ff-1335-41a2-bc04-d4c79d6b67ad tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: b9c20f29-5815-4489-a5fc-7a5ee23b071c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:37.148074 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9dc480ff-1335-41a2-bc04-d4c79d6b67ad tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:37.148530 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9dc480ff-1335-41a2-bc04-d4c79d6b67ad tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:37.149312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9dc480ff-1335-41a2-bc04-d4c79d6b67ad tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:37.149734 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9dc480ff-1335-41a2-bc04-d4c79d6b67ad tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:37.163624 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-9dc480ff-1335-41a2-bc04-d4c79d6b67ad tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] HTTP exception thrown: Instance b9c20f29-5815-4489-a5fc-7a5ee23b071c could not be found. Jun 27 21:25:37.165330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9dc480ff-1335-41a2-bc04-d4c79d6b67ad tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Request method failure captured: Jun 27 21:25:37.165330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c HTTP/1.1 Jun 27 21:25:37.165330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:25:37.165330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:25:37.165330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:25:37.165330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:25:37.165330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:25:37.165330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:25:37.165330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:25:37.165330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:25:37.165330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuiAU0KudqAqB8uPQdVzNSMy2dF78Z7nvWNazms2ankOEqO4KShN43oyWn6T7ncKCbOHK5l3rhXonSJ14qmJsXTBRtc8xpVuvG0rnI2JnFUIaiA--3aX9bN18RhgPQw7e3jKlYgM8C8jk06rqlX-y_Jb4XXM3dEbWlTxMk5z1sdyr1vA Jun 27 21:25:37.165330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:25:37.165330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:25:37.165330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:25:37.165330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:25:37.165330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:25:37.165330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:25:37.165330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: 30944911cb4b49129983d5c19ca7a6bb Jun 27 21:25:37.165330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1783028364 Jun 27 21:25:37.165330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:25:37.165330 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:25:37.167043 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_30944911cb4b49129983d5c19ca7a6bb", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/30944911cb4b49129983d5c19ca7a6bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/30944911cb4b49129983d5c19ca7a6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/30944911cb4b49129983d5c19ca7a6bb"}]}] Jun 27 21:25:37.167043 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-VolumesSnapshotTestJSON-1783028364 Jun 27 21:25:37.167043 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 30944911cb4b49129983d5c19ca7a6bb Jun 27 21:25:37.167043 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1783028364 Jun 27 21:25:37.167043 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-VolumesSnapshotTestJSON-1783028364-project Jun 27 21:25:37.167043 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:25:37.167043 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:25:37.167043 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: c2aa9bdeb9984336bdf103f2d6b1dc13 Jun 27 21:25:37.167043 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-VolumesSnapshotTestJSON-1783028364-project Jun 27 21:25:37.167043 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: > Jun 27 21:25:37.167043 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Instance b9c20f29-5815-4489-a5fc-7a5ee23b071c could not be found. Jun 27 21:25:37.167043 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'id': 'b9c20f29-5815-4489-a5fc-7a5ee23b071c'} Jun 27 21:25:37.167935 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:25:37.167935 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:25:37.167935 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:25:37.167935 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:25:37.167935 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:25:37.167935 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:25:37.167935 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:25:37.167935 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:25:37.167935 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:25:37.167935 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:25:37.167935 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9c20f29-5815-4489-a5fc-7a5ee23b071c could not be found. Jun 27 21:25:37.167935 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:25:37.167935 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:25:37.167935 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:25:37.167935 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:25:37.167935 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:25:37.167935 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:25:37.167935 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:25:37.167935 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:25:37.167935 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:25:37.169361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:25:37.169361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:25:37.169361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:25:37.169361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:25:37.169361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:25:37.169361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:25:37.169361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:25:37.169361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9c20f29-5815-4489-a5fc-7a5ee23b071c could not be found. Jun 27 21:25:37.169361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:25:37.169361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:25:37.169361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:25:37.169361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:25:37.169361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:25:37.169361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:25:37.169361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:25:37.169361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:25:37.169361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9c20f29-5815-4489-a5fc-7a5ee23b071c could not be found. Jun 27 21:25:37.169361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:25:37.170643 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9dc480ff-1335-41a2-bc04-d4c79d6b67ad tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Returning 404 to user: Instance b9c20f29-5815-4489-a5fc-7a5ee23b071c could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:25:37.170643 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9dc480ff-1335-41a2-bc04-d4c79d6b67ad tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c" status: 404 len: 111 microversion: 2.1 time: 0.031212 Jun 27 21:25:37.170643 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 502/973] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:37 2022] GET /compute/v2.1/servers/b9c20f29-5815-4489-a5fc-7a5ee23b071c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:25:37.388563 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0cd0b2cf-2716-4df6-be5a-fda31b13fcb2 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:25:37.389615 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0cd0b2cf-2716-4df6-be5a-fda31b13fcb2 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:37.395983 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0cd0b2cf-2716-4df6-be5a-fda31b13fcb2 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:37.396611 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0cd0b2cf-2716-4df6-be5a-fda31b13fcb2 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:37.397422 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0cd0b2cf-2716-4df6-be5a-fda31b13fcb2 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:37.397847 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0cd0b2cf-2716-4df6-be5a-fda31b13fcb2 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:37.476471 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0cd0b2cf-2716-4df6-be5a-fda31b13fcb2 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "POST /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3/action" status: 202 len: 0 microversion: 2.1 time: 0.088876 Jun 27 21:25:37.476471 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 472/974] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 27 21:25:37 2022] POST /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:25:37.483061 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a93734d0-1397-4552-b602-30ba2ec971e6 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:37.483674 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a93734d0-1397-4552-b602-30ba2ec971e6 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:37.490812 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a93734d0-1397-4552-b602-30ba2ec971e6 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:37.490812 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a93734d0-1397-4552-b602-30ba2ec971e6 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:37.491648 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a93734d0-1397-4552-b602-30ba2ec971e6 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:37.492044 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a93734d0-1397-4552-b602-30ba2ec971e6 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:37.651686 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a93734d0-1397-4552-b602-30ba2ec971e6 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:37.662676 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a93734d0-1397-4552-b602-30ba2ec971e6 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1754 microversion: 2.1 time: 0.183794 Jun 27 21:25:37.663263 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 503/975] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:37 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1754 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:38.682888 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-dec1da4e-4f4d-403f-8c02-ea2d97101349 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:38.683558 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-dec1da4e-4f4d-403f-8c02-ea2d97101349 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:38.690513 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dec1da4e-4f4d-403f-8c02-ea2d97101349 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:38.690983 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dec1da4e-4f4d-403f-8c02-ea2d97101349 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:38.691735 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dec1da4e-4f4d-403f-8c02-ea2d97101349 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:38.692172 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dec1da4e-4f4d-403f-8c02-ea2d97101349 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:38.843093 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-dec1da4e-4f4d-403f-8c02-ea2d97101349 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:38.851654 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-dec1da4e-4f4d-403f-8c02-ea2d97101349 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1754 microversion: 2.1 time: 0.175350 Jun 27 21:25:38.852220 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 473/976] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:38 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:39.875910 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e329ce6a-c401-4789-ac4c-fd0e2a3a9830 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:39.877509 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e329ce6a-c401-4789-ac4c-fd0e2a3a9830 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:39.888253 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e329ce6a-c401-4789-ac4c-fd0e2a3a9830 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:39.888699 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e329ce6a-c401-4789-ac4c-fd0e2a3a9830 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:39.889520 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e329ce6a-c401-4789-ac4c-fd0e2a3a9830 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:39.889945 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e329ce6a-c401-4789-ac4c-fd0e2a3a9830 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:40.049312 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e329ce6a-c401-4789-ac4c-fd0e2a3a9830 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:40.057899 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e329ce6a-c401-4789-ac4c-fd0e2a3a9830 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1754 microversion: 2.1 time: 0.192004 Jun 27 21:25:40.058449 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 504/977] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:39 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1754 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:41.077964 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-875989c1-1ba7-41cd-a8e2-e2a0ae4d4c66 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:41.078657 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-875989c1-1ba7-41cd-a8e2-e2a0ae4d4c66 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:41.087243 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-875989c1-1ba7-41cd-a8e2-e2a0ae4d4c66 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:41.087688 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-875989c1-1ba7-41cd-a8e2-e2a0ae4d4c66 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:41.088493 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-875989c1-1ba7-41cd-a8e2-e2a0ae4d4c66 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:41.088939 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-875989c1-1ba7-41cd-a8e2-e2a0ae4d4c66 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:41.255368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-875989c1-1ba7-41cd-a8e2-e2a0ae4d4c66 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:41.267130 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-875989c1-1ba7-41cd-a8e2-e2a0ae4d4c66 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1759 microversion: 2.1 time: 0.194008 Jun 27 21:25:41.267858 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 474/978] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:41 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1759 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:42.285764 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-30938257-5360-4a5b-827e-7d6d4f6dbe80 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:42.286349 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-30938257-5360-4a5b-827e-7d6d4f6dbe80 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:42.293924 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-30938257-5360-4a5b-827e-7d6d4f6dbe80 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:42.294342 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-30938257-5360-4a5b-827e-7d6d4f6dbe80 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:42.295112 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-30938257-5360-4a5b-827e-7d6d4f6dbe80 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:42.295536 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-30938257-5360-4a5b-827e-7d6d4f6dbe80 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:42.441917 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-30938257-5360-4a5b-827e-7d6d4f6dbe80 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:42.450726 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-30938257-5360-4a5b-827e-7d6d4f6dbe80 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1759 microversion: 2.1 time: 0.168844 Jun 27 21:25:42.451305 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 505/979] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:42 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:43.469676 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-87d3ac67-64c5-4d6e-9a84-2c8c82478baf tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:43.470339 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-87d3ac67-64c5-4d6e-9a84-2c8c82478baf tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:43.477712 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-87d3ac67-64c5-4d6e-9a84-2c8c82478baf tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:43.478164 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-87d3ac67-64c5-4d6e-9a84-2c8c82478baf tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:43.478941 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-87d3ac67-64c5-4d6e-9a84-2c8c82478baf tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:43.479377 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-87d3ac67-64c5-4d6e-9a84-2c8c82478baf tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:43.651636 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-87d3ac67-64c5-4d6e-9a84-2c8c82478baf tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:43.664075 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-87d3ac67-64c5-4d6e-9a84-2c8c82478baf tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1759 microversion: 2.1 time: 0.198061 Jun 27 21:25:43.664773 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 475/980] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:43 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1759 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:44.688790 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8e9ccd3d-d667-41d3-9bc6-91ab0415bae3 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:44.689441 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-8e9ccd3d-d667-41d3-9bc6-91ab0415bae3 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:44.698135 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8e9ccd3d-d667-41d3-9bc6-91ab0415bae3 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:44.698589 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8e9ccd3d-d667-41d3-9bc6-91ab0415bae3 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:44.699373 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8e9ccd3d-d667-41d3-9bc6-91ab0415bae3 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:44.699792 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8e9ccd3d-d667-41d3-9bc6-91ab0415bae3 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:44.858314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8e9ccd3d-d667-41d3-9bc6-91ab0415bae3 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:44.866699 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8e9ccd3d-d667-41d3-9bc6-91ab0415bae3 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1759 microversion: 2.1 time: 0.183877 Jun 27 21:25:44.867479 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 506/981] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:44 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1759 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:44.957140 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b01e924c-6a23-4477-87aa-cbcae297937b tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-82110935", "imageRef": "3155f228-b1ff-487e-837f-85eec68c250a", "flavorRef": "452", "networks": [{"uuid": "df906fd9-a04e-4365-8460-c42478a9b69b"}]}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:25:45.008528 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-b01e924c-6a23-4477-87aa-cbcae297937b tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] validate_networks() for [('df906fd9-a04e-4365-8460-c42478a9b69b', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:25:45.377923 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-b01e924c-6a23-4477-87aa-cbcae297937b tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:25:45.378345 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-b01e924c-6a23-4477-87aa-cbcae297937b tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:25:45.378810 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-b01e924c-6a23-4477-87aa-cbcae297937b tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:25:45.379218 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-b01e924c-6a23-4477-87aa-cbcae297937b tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:25:45.379597 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-b01e924c-6a23-4477-87aa-cbcae297937b tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:25:45.388878 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b01e924c-6a23-4477-87aa-cbcae297937b tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:45.389352 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b01e924c-6a23-4477-87aa-cbcae297937b tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:45.390147 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b01e924c-6a23-4477-87aa-cbcae297937b tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:45.390576 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b01e924c-6a23-4477-87aa-cbcae297937b tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:45.408469 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-b01e924c-6a23-4477-87aa-cbcae297937b tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Getting quotas for project 30944911cb4b49129983d5c19ca7a6bb. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:25:45.412540 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-b01e924c-6a23-4477-87aa-cbcae297937b tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Getting quotas for user c2aa9bdeb9984336bdf103f2d6b1dc13 and project 30944911cb4b49129983d5c19ca7a6bb. Resources: {'instances', 'ram', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:25:45.424180 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b01e924c-6a23-4477-87aa-cbcae297937b tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:25:45.426493 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b01e924c-6a23-4477-87aa-cbcae297937b tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3155f228-b1ff-487e-837f-85eec68c250a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:25:45.480244 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b01e924c-6a23-4477-87aa-cbcae297937b tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527333 Jun 27 21:25:45.480891 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 476/982] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 27 21:25:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:25:45.490914 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e1968275-1a10-43c2-8cf5-954431fa5036 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:45.491519 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e1968275-1a10-43c2-8cf5-954431fa5036 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:45.547961 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e1968275-1a10-43c2-8cf5-954431fa5036 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:45.555450 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e1968275-1a10-43c2-8cf5-954431fa5036 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b" status: 200 len: 1217 microversion: 2.1 time: 0.068202 Jun 27 21:25:45.556138 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 507/983] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:45 2022] GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:45.886157 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d4004dc6-9d08-4db5-b7c4-49c37e78b7ab tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:45.886805 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d4004dc6-9d08-4db5-b7c4-49c37e78b7ab tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:45.894375 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d4004dc6-9d08-4db5-b7c4-49c37e78b7ab tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:45.894893 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d4004dc6-9d08-4db5-b7c4-49c37e78b7ab tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:45.895660 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d4004dc6-9d08-4db5-b7c4-49c37e78b7ab tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:45.896663 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d4004dc6-9d08-4db5-b7c4-49c37e78b7ab tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:46.061090 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d4004dc6-9d08-4db5-b7c4-49c37e78b7ab tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:46.069722 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d4004dc6-9d08-4db5-b7c4-49c37e78b7ab tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1759 microversion: 2.1 time: 0.187806 Jun 27 21:25:46.070430 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 477/984] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:45 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1759 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:46.572885 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-fe309a1f-3342-465c-ba92-c3e455357a78 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:46.573573 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-fe309a1f-3342-465c-ba92-c3e455357a78 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:46.582088 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fe309a1f-3342-465c-ba92-c3e455357a78 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:46.582583 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fe309a1f-3342-465c-ba92-c3e455357a78 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:46.583361 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fe309a1f-3342-465c-ba92-c3e455357a78 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:46.583784 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fe309a1f-3342-465c-ba92-c3e455357a78 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:46.652484 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-fe309a1f-3342-465c-ba92-c3e455357a78 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:46.660252 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-fe309a1f-3342-465c-ba92-c3e455357a78 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b" status: 200 len: 1287 microversion: 2.1 time: 0.092021 Jun 27 21:25:46.661452 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 508/985] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:46 2022] GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b => generated 1287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:47.087894 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fc84eefa-3bfb-4bb0-b168-763b1a520e77 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:47.089241 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fc84eefa-3bfb-4bb0-b168-763b1a520e77 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:47.096367 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc84eefa-3bfb-4bb0-b168-763b1a520e77 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:47.096822 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc84eefa-3bfb-4bb0-b168-763b1a520e77 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:47.097610 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc84eefa-3bfb-4bb0-b168-763b1a520e77 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:47.098234 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc84eefa-3bfb-4bb0-b168-763b1a520e77 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:47.318544 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fc84eefa-3bfb-4bb0-b168-763b1a520e77 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:47.327227 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fc84eefa-3bfb-4bb0-b168-763b1a520e77 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1759 microversion: 2.1 time: 0.243326 Jun 27 21:25:47.327828 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 478/986] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:47 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1759 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:47.678734 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7cb8451e-6683-49eb-b05d-70eb07384ed6 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:47.679369 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7cb8451e-6683-49eb-b05d-70eb07384ed6 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:47.687079 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7cb8451e-6683-49eb-b05d-70eb07384ed6 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:47.687521 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7cb8451e-6683-49eb-b05d-70eb07384ed6 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:47.688264 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7cb8451e-6683-49eb-b05d-70eb07384ed6 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:47.688685 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7cb8451e-6683-49eb-b05d-70eb07384ed6 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:47.823878 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7cb8451e-6683-49eb-b05d-70eb07384ed6 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:47.831805 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7cb8451e-6683-49eb-b05d-70eb07384ed6 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b" status: 200 len: 1317 microversion: 2.1 time: 0.157027 Jun 27 21:25:47.832343 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 509/987] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:47 2022] GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:48.237378 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-88bb38f9-b804-44ba-90c1-0ce5074f7312 req-a6ad4eac-2a87-458d-a87a-44abdd984c39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b", "tag": "3928436d-16cb-4539-9add-d7f1258e2a4c"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:25:48.246883 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-88bb38f9-b804-44ba-90c1-0ce5074f7312 req-a6ad4eac-2a87-458d-a87a-44abdd984c39 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:48.247326 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-88bb38f9-b804-44ba-90c1-0ce5074f7312 req-a6ad4eac-2a87-458d-a87a-44abdd984c39 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:48.258957 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-88bb38f9-b804-44ba-90c1-0ce5074f7312 req-a6ad4eac-2a87-458d-a87a-44abdd984c39 service nova] Creating event network-changed:3928436d-16cb-4539-9add-d7f1258e2a4c for instance 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b on hv-cinder-84773 Jun 27 21:25:48.263819 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-88bb38f9-b804-44ba-90c1-0ce5074f7312 req-a6ad4eac-2a87-458d-a87a-44abdd984c39 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030218 Jun 27 21:25:48.264413 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 479/988] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:25:48.348128 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-99825811-6f76-4dc3-ae8c-a187c486d95f tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:48.348979 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-99825811-6f76-4dc3-ae8c-a187c486d95f tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:48.356523 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-99825811-6f76-4dc3-ae8c-a187c486d95f tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:48.356960 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-99825811-6f76-4dc3-ae8c-a187c486d95f tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:48.357739 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-99825811-6f76-4dc3-ae8c-a187c486d95f tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:48.358167 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-99825811-6f76-4dc3-ae8c-a187c486d95f tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:48.507151 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-99825811-6f76-4dc3-ae8c-a187c486d95f tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:48.516587 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-99825811-6f76-4dc3-ae8c-a187c486d95f tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1759 microversion: 2.1 time: 0.174794 Jun 27 21:25:48.517189 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 510/989] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:48 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1759 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:48.849894 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9db57af7-84b4-4cab-a3dc-c01da38c4a77 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:48.850479 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9db57af7-84b4-4cab-a3dc-c01da38c4a77 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:48.857845 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9db57af7-84b4-4cab-a3dc-c01da38c4a77 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:48.858279 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9db57af7-84b4-4cab-a3dc-c01da38c4a77 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:48.859030 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9db57af7-84b4-4cab-a3dc-c01da38c4a77 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:48.859455 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9db57af7-84b4-4cab-a3dc-c01da38c4a77 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:49.019543 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9db57af7-84b4-4cab-a3dc-c01da38c4a77 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:49.027762 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9db57af7-84b4-4cab-a3dc-c01da38c4a77 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b" status: 200 len: 1317 microversion: 2.1 time: 0.182225 Jun 27 21:25:49.028342 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 480/990] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:48 2022] GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:49.536583 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0b88a90a-e974-4d55-b7c3-09a1ce6e44e9 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:49.537454 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0b88a90a-e974-4d55-b7c3-09a1ce6e44e9 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:49.548243 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0b88a90a-e974-4d55-b7c3-09a1ce6e44e9 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:49.548872 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0b88a90a-e974-4d55-b7c3-09a1ce6e44e9 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:49.550099 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0b88a90a-e974-4d55-b7c3-09a1ce6e44e9 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:49.550720 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0b88a90a-e974-4d55-b7c3-09a1ce6e44e9 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:49.703429 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0b88a90a-e974-4d55-b7c3-09a1ce6e44e9 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:49.713544 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0b88a90a-e974-4d55-b7c3-09a1ce6e44e9 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1759 microversion: 2.1 time: 0.183114 Jun 27 21:25:49.714131 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 511/991] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:49 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1759 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:50.048456 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a60f5915-4731-4f96-8ad9-c6113e2626d2 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:50.049619 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a60f5915-4731-4f96-8ad9-c6113e2626d2 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:50.062079 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a60f5915-4731-4f96-8ad9-c6113e2626d2 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:50.063404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a60f5915-4731-4f96-8ad9-c6113e2626d2 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:50.064426 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a60f5915-4731-4f96-8ad9-c6113e2626d2 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:50.065092 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a60f5915-4731-4f96-8ad9-c6113e2626d2 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:50.249183 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a60f5915-4731-4f96-8ad9-c6113e2626d2 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:50.259992 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a60f5915-4731-4f96-8ad9-c6113e2626d2 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b" status: 200 len: 1317 microversion: 2.1 time: 0.219560 Jun 27 21:25:50.260568 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 481/992] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:50 2022] GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:50.733306 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6eb436df-7b49-495e-a0ab-f42c95ed2def tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:50.733934 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6eb436df-7b49-495e-a0ab-f42c95ed2def tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:50.743860 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6eb436df-7b49-495e-a0ab-f42c95ed2def tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:50.744303 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6eb436df-7b49-495e-a0ab-f42c95ed2def tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:50.745114 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6eb436df-7b49-495e-a0ab-f42c95ed2def tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:50.745546 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6eb436df-7b49-495e-a0ab-f42c95ed2def tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:51.034376 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-6eb436df-7b49-495e-a0ab-f42c95ed2def tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:51.044518 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6eb436df-7b49-495e-a0ab-f42c95ed2def tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1759 microversion: 2.1 time: 0.316510 Jun 27 21:25:51.045109 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 512/993] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:50 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1759 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:51.278156 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8327fdde-bc5f-4640-b63f-318329796529 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:51.278773 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8327fdde-bc5f-4640-b63f-318329796529 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:51.285780 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8327fdde-bc5f-4640-b63f-318329796529 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:51.286228 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8327fdde-bc5f-4640-b63f-318329796529 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:51.286992 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8327fdde-bc5f-4640-b63f-318329796529 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:51.287414 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8327fdde-bc5f-4640-b63f-318329796529 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:51.435054 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8327fdde-bc5f-4640-b63f-318329796529 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:51.446651 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8327fdde-bc5f-4640-b63f-318329796529 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b" status: 200 len: 1317 microversion: 2.1 time: 0.173151 Jun 27 21:25:51.447232 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 482/994] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:51 2022] GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:52.065001 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e26f1c83-fd97-4438-a1f7-ba28e1f01f28 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:52.065620 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e26f1c83-fd97-4438-a1f7-ba28e1f01f28 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:52.074787 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e26f1c83-fd97-4438-a1f7-ba28e1f01f28 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:52.075227 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e26f1c83-fd97-4438-a1f7-ba28e1f01f28 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:52.075987 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e26f1c83-fd97-4438-a1f7-ba28e1f01f28 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:52.076411 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e26f1c83-fd97-4438-a1f7-ba28e1f01f28 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:52.468775 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-20b64c8d-d893-40df-a286-dbb8d9e6c77e tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:52.469407 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-20b64c8d-d893-40df-a286-dbb8d9e6c77e tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:52.475919 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-20b64c8d-d893-40df-a286-dbb8d9e6c77e tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:52.476357 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-20b64c8d-d893-40df-a286-dbb8d9e6c77e tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:52.477142 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-20b64c8d-d893-40df-a286-dbb8d9e6c77e tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:52.477567 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-20b64c8d-d893-40df-a286-dbb8d9e6c77e tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:52.483149 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e26f1c83-fd97-4438-a1f7-ba28e1f01f28 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:52.491265 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e26f1c83-fd97-4438-a1f7-ba28e1f01f28 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1762 microversion: 2.1 time: 0.432355 Jun 27 21:25:52.491865 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 513/995] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:52 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1762 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:52.615598 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-20b64c8d-d893-40df-a286-dbb8d9e6c77e tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:52.628109 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-20b64c8d-d893-40df-a286-dbb8d9e6c77e tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b" status: 200 len: 1317 microversion: 2.1 time: 0.163513 Jun 27 21:25:52.628889 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 483/996] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:52 2022] GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:53.647794 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4f72a322-660f-401f-801d-18864557c3d3 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:53.648461 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4f72a322-660f-401f-801d-18864557c3d3 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:53.656953 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f72a322-660f-401f-801d-18864557c3d3 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:53.657416 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f72a322-660f-401f-801d-18864557c3d3 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:53.658181 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f72a322-660f-401f-801d-18864557c3d3 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:53.658610 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f72a322-660f-401f-801d-18864557c3d3 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:53.808724 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4f72a322-660f-401f-801d-18864557c3d3 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:53.816477 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4f72a322-660f-401f-801d-18864557c3d3 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b" status: 200 len: 1317 microversion: 2.1 time: 0.172663 Jun 27 21:25:53.817097 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 514/997] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:53 2022] GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:53.850968 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-78a739fc-1230-4ba5-8448-10f5e76dd9cc req-b02bbf61-5c6e-4243-8961-2b5c7af32bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b", "name": "network-vif-plugged", "status": "completed", "tag": "3928436d-16cb-4539-9add-d7f1258e2a4c"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:25:53.861206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-78a739fc-1230-4ba5-8448-10f5e76dd9cc req-b02bbf61-5c6e-4243-8961-2b5c7af32bb6 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:53.861622 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-78a739fc-1230-4ba5-8448-10f5e76dd9cc req-b02bbf61-5c6e-4243-8961-2b5c7af32bb6 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:53.867358 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:25:53.875050 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-78a739fc-1230-4ba5-8448-10f5e76dd9cc req-b02bbf61-5c6e-4243-8961-2b5c7af32bb6 service nova] Creating event network-vif-plugged:3928436d-16cb-4539-9add-d7f1258e2a4c for instance 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b on hv-cinder-84773 Jun 27 21:25:53.880349 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-78a739fc-1230-4ba5-8448-10f5e76dd9cc req-b02bbf61-5c6e-4243-8961-2b5c7af32bb6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033251 Jun 27 21:25:53.881203 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 484/998] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:25:54.834450 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-02df666b-e915-4df1-acc3-bef6229254f1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:54.835112 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-02df666b-e915-4df1-acc3-bef6229254f1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:54.842265 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-02df666b-e915-4df1-acc3-bef6229254f1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:54.842700 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-02df666b-e915-4df1-acc3-bef6229254f1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:54.843457 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-02df666b-e915-4df1-acc3-bef6229254f1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:54.843883 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-02df666b-e915-4df1-acc3-bef6229254f1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:54.980555 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-02df666b-e915-4df1-acc3-bef6229254f1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:54.992449 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-02df666b-e915-4df1-acc3-bef6229254f1 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b" status: 200 len: 1317 microversion: 2.1 time: 0.161695 Jun 27 21:25:54.993378 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 515/999] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:54 2022] GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:56.007683 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:25:56.008437 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:25:56.013276 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fccab038-07c8-4885-b543-199c53eac5dc tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:56.013947 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fccab038-07c8-4885-b543-199c53eac5dc tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:56.022233 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fccab038-07c8-4885-b543-199c53eac5dc tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:56.022678 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fccab038-07c8-4885-b543-199c53eac5dc tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:56.023429 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fccab038-07c8-4885-b543-199c53eac5dc tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:56.023855 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fccab038-07c8-4885-b543-199c53eac5dc tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:56.228239 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fccab038-07c8-4885-b543-199c53eac5dc tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:56.236146 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fccab038-07c8-4885-b543-199c53eac5dc tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b" status: 200 len: 1505 microversion: 2.1 time: 0.229851 Jun 27 21:25:56.236717 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 485/1000] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:56 2022] GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:56.258110 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6c87e6dc-5f90-47f6-b9f3-e03bd00d3788 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a49ef1c3-c4f7-41a0-a72a-6078e953f768", "device": "/dev/sdb"}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:25:56.259697 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6c87e6dc-5f90-47f6-b9f3-e03bd00d3788 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:56.261748 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:25:56.267825 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6c87e6dc-5f90-47f6-b9f3-e03bd00d3788 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:56.268278 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6c87e6dc-5f90-47f6-b9f3-e03bd00d3788 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:56.269048 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6c87e6dc-5f90-47f6-b9f3-e03bd00d3788 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:56.269477 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6c87e6dc-5f90-47f6-b9f3-e03bd00d3788 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:56.428463 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:25:56.566208 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6c87e6dc-5f90-47f6-b9f3-e03bd00d3788 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "POST /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312082 Jun 27 21:25:56.566824 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 516/1001] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 27 21:25:56 2022] POST /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:26:14.997142 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-edaad9af-b48a-4c24-8474-a0247f54167a tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:14.997710 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-edaad9af-b48a-4c24-8474-a0247f54167a tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:14.999620 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:26:15.000370 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:26:15.007098 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-edaad9af-b48a-4c24-8474-a0247f54167a tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:15.007541 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-edaad9af-b48a-4c24-8474-a0247f54167a tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:15.008295 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-edaad9af-b48a-4c24-8474-a0247f54167a tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:15.008723 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-edaad9af-b48a-4c24-8474-a0247f54167a tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:15.100449 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-edaad9af-b48a-4c24-8474-a0247f54167a tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lazy-loading 'services' on Instance uuid 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:26:15.184618 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-edaad9af-b48a-4c24-8474-a0247f54167a tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b/os-volume_attachments/a49ef1c3-c4f7-41a0-a72a-6078e953f768" status: 202 len: 0 microversion: 2.1 time: 0.191448 Jun 27 21:26:15.185377 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 486/1002] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 27 21:26:14 2022] DELETE /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b/os-volume_attachments/a49ef1c3-c4f7-41a0-a72a-6078e953f768 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:26:16.318626 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=38 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:26:16.319502 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:26:16.323991 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-35c23e42-4b45-4ef5-baa1-185cd67fff66 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:16.324582 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-35c23e42-4b45-4ef5-baa1-185cd67fff66 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:16.333335 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-35c23e42-4b45-4ef5-baa1-185cd67fff66 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:16.333778 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-35c23e42-4b45-4ef5-baa1-185cd67fff66 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:16.334608 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-35c23e42-4b45-4ef5-baa1-185cd67fff66 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:16.335035 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-35c23e42-4b45-4ef5-baa1-185cd67fff66 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:16.367949 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-35c23e42-4b45-4ef5-baa1-185cd67fff66 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b] Going to try to terminate instance {{(pid=117891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:26:16.464558 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-35c23e42-4b45-4ef5-baa1-185cd67fff66 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b" status: 204 len: 0 microversion: 2.1 time: 0.148324 Jun 27 21:26:16.465254 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 517/1003] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:26:16 2022] DELETE /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:26:16.477015 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e48136de-59a4-4d09-b633-cb1d9d7c9f06 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:16.477864 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e48136de-59a4-4d09-b633-cb1d9d7c9f06 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:16.484975 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e48136de-59a4-4d09-b633-cb1d9d7c9f06 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:16.485411 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e48136de-59a4-4d09-b633-cb1d9d7c9f06 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:16.486189 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e48136de-59a4-4d09-b633-cb1d9d7c9f06 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:16.486875 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e48136de-59a4-4d09-b633-cb1d9d7c9f06 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:16.632110 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e48136de-59a4-4d09-b633-cb1d9d7c9f06 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:16.640290 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e48136de-59a4-4d09-b633-cb1d9d7c9f06 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b" status: 200 len: 1511 microversion: 2.1 time: 0.168589 Jun 27 21:26:16.640868 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 487/1004] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:16 2022] GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:17.658842 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1494fd16-b402-4401-89a6-30d1fbb910c5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:17.659647 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1494fd16-b402-4401-89a6-30d1fbb910c5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:17.667267 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1494fd16-b402-4401-89a6-30d1fbb910c5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:17.667755 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1494fd16-b402-4401-89a6-30d1fbb910c5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:17.668594 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1494fd16-b402-4401-89a6-30d1fbb910c5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:17.669111 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1494fd16-b402-4401-89a6-30d1fbb910c5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:17.810502 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1494fd16-b402-4401-89a6-30d1fbb910c5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:17.819457 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1494fd16-b402-4401-89a6-30d1fbb910c5 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b" status: 200 len: 1511 microversion: 2.1 time: 0.165355 Jun 27 21:26:17.820324 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 518/1005] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:17 2022] GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:18.771080 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-701dc36e-f3bb-4148-8f17-061713697ef3 req-686afc31-be73-4cbe-af23-37ec0b61af8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b", "name": "network-vif-deleted", "tag": "3928436d-16cb-4539-9add-d7f1258e2a4c"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:26:18.780506 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-701dc36e-f3bb-4148-8f17-061713697ef3 req-686afc31-be73-4cbe-af23-37ec0b61af8d service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:18.780948 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-701dc36e-f3bb-4148-8f17-061713697ef3 req-686afc31-be73-4cbe-af23-37ec0b61af8d service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:18.792780 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-701dc36e-f3bb-4148-8f17-061713697ef3 req-686afc31-be73-4cbe-af23-37ec0b61af8d service nova] Creating event network-vif-deleted:3928436d-16cb-4539-9add-d7f1258e2a4c for instance 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b on hv-cinder-84773 Jun 27 21:26:18.798229 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-701dc36e-f3bb-4148-8f17-061713697ef3 req-686afc31-be73-4cbe-af23-37ec0b61af8d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030925 Jun 27 21:26:18.799369 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 488/1006] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:26:18.842254 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-cff8c9b7-4542-4890-9134-107c265ac118 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:18.842878 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-cff8c9b7-4542-4890-9134-107c265ac118 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:18.850543 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cff8c9b7-4542-4890-9134-107c265ac118 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:18.851079 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cff8c9b7-4542-4890-9134-107c265ac118 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:18.851932 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cff8c9b7-4542-4890-9134-107c265ac118 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:18.852434 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cff8c9b7-4542-4890-9134-107c265ac118 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:18.925024 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-cff8c9b7-4542-4890-9134-107c265ac118 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2aa9bdeb9984336bdf103f2d6b1dc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30944911cb4b49129983d5c19ca7a6bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:18.932899 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-cff8c9b7-4542-4890-9134-107c265ac118 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b" status: 200 len: 1302 microversion: 2.1 time: 0.094636 Jun 27 21:26:18.933508 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 519/1007] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:18 2022] GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b => generated 1302 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:19.952160 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1f558b26-0e63-4644-9937-f815f4b56957 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:19.952833 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1f558b26-0e63-4644-9937-f815f4b56957 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] [instance: 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:19.960704 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1f558b26-0e63-4644-9937-f815f4b56957 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:19.961181 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1f558b26-0e63-4644-9937-f815f4b56957 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:19.961966 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1f558b26-0e63-4644-9937-f815f4b56957 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:19.962392 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1f558b26-0e63-4644-9937-f815f4b56957 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:19.975863 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-1f558b26-0e63-4644-9937-f815f4b56957 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] HTTP exception thrown: Instance 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b could not be found. Jun 27 21:26:19.977551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1f558b26-0e63-4644-9937-f815f4b56957 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Request method failure captured: Jun 27 21:26:19.977551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b HTTP/1.1 Jun 27 21:26:19.977551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:26:19.977551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:26:19.977551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:26:19.977551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:26:19.977551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:26:19.977551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:26:19.977551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:26:19.977551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:26:19.977551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuiAU0KudqAqB8uPQdVzNSMy2dF78Z7nvWNazms2ankOEqO4KShN43oyWn6T7ncKCbOHK5l3rhXonSJ14qmJsXTBRtc8xpVuvG0rnI2JnFUIaiA--3aX9bN18RhgPQw7e3jKlYgM8C8jk06rqlX-y_Jb4XXM3dEbWlTxMk5z1sdyr1vA Jun 27 21:26:19.977551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:26:19.977551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:26:19.977551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:26:19.977551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:26:19.977551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:26:19.977551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:26:19.977551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 30944911cb4b49129983d5c19ca7a6bb Jun 27 21:26:19.977551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1783028364 Jun 27 21:26:19.977551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:26:19.977551 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:26:19.979328 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_30944911cb4b49129983d5c19ca7a6bb", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/30944911cb4b49129983d5c19ca7a6bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/30944911cb4b49129983d5c19ca7a6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/30944911cb4b49129983d5c19ca7a6bb"}]}] Jun 27 21:26:19.979328 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesSnapshotTestJSON-1783028364 Jun 27 21:26:19.979328 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 30944911cb4b49129983d5c19ca7a6bb Jun 27 21:26:19.979328 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1783028364 Jun 27 21:26:19.979328 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesSnapshotTestJSON-1783028364-project Jun 27 21:26:19.979328 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:26:19.979328 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:26:19.979328 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: c2aa9bdeb9984336bdf103f2d6b1dc13 Jun 27 21:26:19.979328 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesSnapshotTestJSON-1783028364-project Jun 27 21:26:19.979328 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:26:19.979328 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b could not be found. Jun 27 21:26:19.979328 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b'} Jun 27 21:26:19.980309 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:26:19.980309 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:26:19.980309 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:26:19.980309 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:26:19.980309 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:26:19.980309 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:26:19.980309 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:26:19.980309 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:26:19.980309 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:26:19.980309 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:26:19.980309 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b could not be found. Jun 27 21:26:19.980309 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:26:19.980309 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:26:19.980309 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:26:19.980309 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:26:19.980309 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:26:19.980309 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:26:19.980309 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:26:19.980309 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:26:19.980309 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:26:19.981953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:26:19.981953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:26:19.981953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:26:19.981953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:26:19.981953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:26:19.981953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:26:19.981953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:26:19.981953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b could not be found. Jun 27 21:26:19.981953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:26:19.981953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:26:19.981953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:26:19.981953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:26:19.981953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:26:19.981953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:26:19.981953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:26:19.981953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:26:19.981953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b could not be found. Jun 27 21:26:19.981953 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:26:19.983577 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1f558b26-0e63-4644-9937-f815f4b56957 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] Returning 404 to user: Instance 3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:26:19.983577 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1f558b26-0e63-4644-9937-f815f4b56957 tempest-VolumesSnapshotTestJSON-1783028364 tempest-VolumesSnapshotTestJSON-1783028364-project] 10.222.0.13 "GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b" status: 404 len: 111 microversion: 2.1 time: 0.032228 Jun 27 21:26:19.983577 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 489/1008] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:19 2022] GET /compute/v2.1/servers/3b7eb428-65e6-49ea-9c5c-4b67ef6ead1b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:26:31.648351 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1881e547-58fe-4a38-9cf2-b4cffec610da tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2068254880"}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:26:31.649140 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1881e547-58fe-4a38-9cf2-b4cffec610da tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:31.651623 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:26:31.652276 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:26:31.658906 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1881e547-58fe-4a38-9cf2-b4cffec610da tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:31.659350 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1881e547-58fe-4a38-9cf2-b4cffec610da tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:31.660160 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1881e547-58fe-4a38-9cf2-b4cffec610da tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:31.660628 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1881e547-58fe-4a38-9cf2-b4cffec610da tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:31.813519 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.network.security_group_api [None req-1881e547-58fe-4a38-9cf2-b4cffec610da tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Removing security group 0a5e80ec-59fc-422d-a9fa-b10f43bcde05 from port 327711ca-a708-4b77-8455-a571c628332b Jun 27 21:26:32.191898 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1881e547-58fe-4a38-9cf2-b4cffec610da tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "POST /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3/action" status: 202 len: 0 microversion: 2.1 time: 0.547713 Jun 27 21:26:32.195581 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 520/1009] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 27 21:26:31 2022] POST /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:26:32.200878 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-a9aabd4a-0d8e-4991-b7b9-9b52de811281 req-95390d57-9138-4ae6-a7f8-a79e84282323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d342f76-2548-4bed-8f8e-1b722c8e61e3", "tag": "327711ca-a708-4b77-8455-a571c628332b"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:26:32.208319 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=8 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:26:32.210946 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:26:32.218680 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a9aabd4a-0d8e-4991-b7b9-9b52de811281 req-95390d57-9138-4ae6-a7f8-a79e84282323 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:32.224480 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a9aabd4a-0d8e-4991-b7b9-9b52de811281 req-95390d57-9138-4ae6-a7f8-a79e84282323 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:32.261609 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-a9aabd4a-0d8e-4991-b7b9-9b52de811281 req-95390d57-9138-4ae6-a7f8-a79e84282323 service nova] Creating event network-changed:327711ca-a708-4b77-8455-a571c628332b for instance 3d342f76-2548-4bed-8f8e-1b722c8e61e3 on hv-cinder-84773 Jun 27 21:26:32.267891 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-a9aabd4a-0d8e-4991-b7b9-9b52de811281 req-95390d57-9138-4ae6-a7f8-a79e84282323 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070588 Jun 27 21:26:32.269117 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 490/1010] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:26:33.390616 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4b2629eb-20b9-49ef-b5af-25a693a486be tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:33.391216 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4b2629eb-20b9-49ef-b5af-25a693a486be tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:33.398242 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4b2629eb-20b9-49ef-b5af-25a693a486be tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:33.398770 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4b2629eb-20b9-49ef-b5af-25a693a486be tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:33.399616 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4b2629eb-20b9-49ef-b5af-25a693a486be tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:33.400112 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4b2629eb-20b9-49ef-b5af-25a693a486be tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:33.492096 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-4b2629eb-20b9-49ef-b5af-25a693a486be tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lazy-loading 'services' on Instance uuid 3d342f76-2548-4bed-8f8e-1b722c8e61e3 {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:26:33.597314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4b2629eb-20b9-49ef-b5af-25a693a486be tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3/os-volume_attachments/c06dc492-ca54-46d7-bac6-298ed58ea1b9" status: 202 len: 0 microversion: 2.1 time: 0.210975 Jun 27 21:26:33.598061 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 521/1011] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 27 21:26:33 2022] DELETE /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3/os-volume_attachments/c06dc492-ca54-46d7-bac6-298ed58ea1b9 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:26:33.616139 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1076ad96-421d-49e7-a5db-5b09674637d1 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:33.618393 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1076ad96-421d-49e7-a5db-5b09674637d1 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:33.630783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1076ad96-421d-49e7-a5db-5b09674637d1 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:33.631589 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1076ad96-421d-49e7-a5db-5b09674637d1 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:33.632982 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1076ad96-421d-49e7-a5db-5b09674637d1 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:33.633783 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1076ad96-421d-49e7-a5db-5b09674637d1 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:33.684470 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1076ad96-421d-49e7-a5db-5b09674637d1 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077979 Jun 27 21:26:33.689775 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 491/1012] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 27 21:26:33 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:26:34.294166 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-1b020545-b996-458e-b5b9-18a68ef771d9 req-b85d99eb-aaf9-46e9-98d9-ce0ec108f597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d342f76-2548-4bed-8f8e-1b722c8e61e3", "tag": "327711ca-a708-4b77-8455-a571c628332b"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:26:34.304109 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-1b020545-b996-458e-b5b9-18a68ef771d9 req-b85d99eb-aaf9-46e9-98d9-ce0ec108f597 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:34.304515 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-1b020545-b996-458e-b5b9-18a68ef771d9 req-b85d99eb-aaf9-46e9-98d9-ce0ec108f597 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:34.317280 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-1b020545-b996-458e-b5b9-18a68ef771d9 req-b85d99eb-aaf9-46e9-98d9-ce0ec108f597 service nova] Creating event network-changed:327711ca-a708-4b77-8455-a571c628332b for instance 3d342f76-2548-4bed-8f8e-1b722c8e61e3 on hv-cinder-84773 Jun 27 21:26:34.323650 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-1b020545-b996-458e-b5b9-18a68ef771d9 req-b85d99eb-aaf9-46e9-98d9-ce0ec108f597 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033452 Jun 27 21:26:34.324435 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 522/1013] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:26:34.702478 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-07bdf2b7-ceed-47a8-9373-d2c891a3cbd5 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:34.705326 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-07bdf2b7-ceed-47a8-9373-d2c891a3cbd5 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:34.716668 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-07bdf2b7-ceed-47a8-9373-d2c891a3cbd5 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:34.717804 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-07bdf2b7-ceed-47a8-9373-d2c891a3cbd5 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:34.719398 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-07bdf2b7-ceed-47a8-9373-d2c891a3cbd5 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:34.720319 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-07bdf2b7-ceed-47a8-9373-d2c891a3cbd5 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:34.761979 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-07bdf2b7-ceed-47a8-9373-d2c891a3cbd5 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068671 Jun 27 21:26:34.762869 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 492/1014] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 27 21:26:34 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 21:26:34.780378 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8590f7b1-e30c-434d-bd49-91aab42f5016 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:34.781789 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-8590f7b1-e30c-434d-bd49-91aab42f5016 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:34.791478 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8590f7b1-e30c-434d-bd49-91aab42f5016 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:34.792297 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8590f7b1-e30c-434d-bd49-91aab42f5016 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:34.793416 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8590f7b1-e30c-434d-bd49-91aab42f5016 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:34.793944 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8590f7b1-e30c-434d-bd49-91aab42f5016 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:34.877265 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-8590f7b1-e30c-434d-bd49-91aab42f5016 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] HTTP exception thrown: Instance 3d342f76-2548-4bed-8f8e-1b722c8e61e3 is not attached to volume c06dc492-ca54-46d7-bac6-298ed58ea1b9 Jun 27 21:26:34.880069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8590f7b1-e30c-434d-bd49-91aab42f5016 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Request method failure captured: Jun 27 21:26:34.880069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: DELETE /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3/os-volume_attachments/c06dc492-ca54-46d7-bac6-298ed58ea1b9 HTTP/1.1 Jun 27 21:26:34.880069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:26:34.880069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:26:34.880069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:26:34.880069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:26:34.880069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:26:34.880069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:26:34.880069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:26:34.880069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:26:34.880069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh_9QzCFgy-iAdml8pD7V9BzEjUWOVnef7sUA9oyTCqqnK__8eAIa9MBW7zO9HwgIx81a-KW7Hx30SvZq4OUaoNUV74tPe9hc3VkAkz0uzWCLPhecWzhEFZntlfaXpBXo-DraFZnKBlkDR6gSfotjHhTHBY6clUybBGg4XzI3SYqNXw Jun 27 21:26:34.880069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:26:34.880069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:26:34.880069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:26:34.880069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:26:34.880069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:26:34.880069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:26:34.880069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: c9f86d6febe04e8f9745d787914b6d5c Jun 27 21:26:34.880069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-TestMinimumBasicScenario-1239397201 Jun 27 21:26:34.880069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:26:34.880069 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:26:34.882314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c9f86d6febe04e8f9745d787914b6d5c", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c9f86d6febe04e8f9745d787914b6d5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c9f86d6febe04e8f9745d787914b6d5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c9f86d6febe04e8f9745d787914b6d5c"}]}] Jun 27 21:26:34.882314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-TestMinimumBasicScenario-1239397201 Jun 27 21:26:34.882314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: c9f86d6febe04e8f9745d787914b6d5c Jun 27 21:26:34.882314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1239397201 Jun 27 21:26:34.882314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-TestMinimumBasicScenario-1239397201-project Jun 27 21:26:34.882314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:26:34.882314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:26:34.882314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: 4d867759b4f249a393598964774a22fa Jun 27 21:26:34.882314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-TestMinimumBasicScenario-1239397201-project Jun 27 21:26:34.882314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: > Jun 27 21:26:34.882314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Instance 3d342f76-2548-4bed-8f8e-1b722c8e61e3 is not attached to volume c06dc492-ca54-46d7-bac6-298ed58ea1b9 Jun 27 21:26:34.883227 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'server_id': '3d342f76-2548-4bed-8f8e-1b722c8e61e3', 'id': 'c06dc492-ca54-46d7-bac6-298ed58ea1b9'} Jun 27 21:26:34.883227 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:26:34.883227 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:26:34.883227 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 27 21:26:34.883227 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 27 21:26:34.883227 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 21:26:34.883227 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 21:26:34.883227 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 27 21:26:34.883227 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 27 21:26:34.883227 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c06dc492-ca54-46d7-bac6-298ed58ea1b9. Jun 27 21:26:34.883227 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:26:34.883227 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:26:34.883227 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:26:34.883227 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:26:34.883227 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:26:34.883227 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:26:34.883227 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:26:34.883227 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:26:34.883227 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:26:34.884512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:26:34.884512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 27 21:26:34.884512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 27 21:26:34.884512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d342f76-2548-4bed-8f8e-1b722c8e61e3 is not attached to volume c06dc492-ca54-46d7-bac6-298ed58ea1b9 Jun 27 21:26:34.884512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:26:34.884512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:26:34.884512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:26:34.884512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:26:34.884512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:26:34.884512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:26:34.884512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:26:34.884512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:26:34.884512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d342f76-2548-4bed-8f8e-1b722c8e61e3 is not attached to volume c06dc492-ca54-46d7-bac6-298ed58ea1b9 Jun 27 21:26:34.884512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:26:34.884512 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8590f7b1-e30c-434d-bd49-91aab42f5016 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Returning 404 to user: Instance 3d342f76-2548-4bed-8f8e-1b722c8e61e3 is not attached to volume c06dc492-ca54-46d7-bac6-298ed58ea1b9 {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:26:34.886279 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8590f7b1-e30c-434d-bd49-91aab42f5016 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3/os-volume_attachments/c06dc492-ca54-46d7-bac6-298ed58ea1b9" status: 404 len: 154 microversion: 2.1 time: 0.111403 Jun 27 21:26:34.886279 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 523/1015] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 27 21:26:34 2022] DELETE /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3/os-volume_attachments/c06dc492-ca54-46d7-bac6-298ed58ea1b9 => generated 154 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:26:36.024985 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-73bdf00e-0ca8-4339-88b7-63fa6101b2a7 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:36.025596 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-73bdf00e-0ca8-4339-88b7-63fa6101b2a7 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:36.032515 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-73bdf00e-0ca8-4339-88b7-63fa6101b2a7 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:36.032970 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-73bdf00e-0ca8-4339-88b7-63fa6101b2a7 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:36.033749 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-73bdf00e-0ca8-4339-88b7-63fa6101b2a7 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:36.034185 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-73bdf00e-0ca8-4339-88b7-63fa6101b2a7 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:36.059398 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-73bdf00e-0ca8-4339-88b7-63fa6101b2a7 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:26:36.140272 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-73bdf00e-0ca8-4339-88b7-63fa6101b2a7 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 204 len: 0 microversion: 2.1 time: 0.118837 Jun 27 21:26:36.141025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 493/1016] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:26:36 2022] DELETE /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:26:36.149914 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7301076d-3e19-42f3-806a-86b274b505ff tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:36.150513 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7301076d-3e19-42f3-806a-86b274b505ff tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:36.157601 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7301076d-3e19-42f3-806a-86b274b505ff tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:36.158021 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7301076d-3e19-42f3-806a-86b274b505ff tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:36.158816 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7301076d-3e19-42f3-806a-86b274b505ff tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:36.159230 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7301076d-3e19-42f3-806a-86b274b505ff tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:36.297981 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7301076d-3e19-42f3-806a-86b274b505ff tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:36.306501 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7301076d-3e19-42f3-806a-86b274b505ff tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1556 microversion: 2.1 time: 0.160529 Jun 27 21:26:36.307050 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 524/1017] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:36 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:26:37.325330 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-053e09e3-d039-496d-a34c-90803f901033 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:37.325926 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-053e09e3-d039-496d-a34c-90803f901033 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:37.333708 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-053e09e3-d039-496d-a34c-90803f901033 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:37.334144 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-053e09e3-d039-496d-a34c-90803f901033 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:37.334902 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-053e09e3-d039-496d-a34c-90803f901033 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:37.335328 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-053e09e3-d039-496d-a34c-90803f901033 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:37.488459 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-053e09e3-d039-496d-a34c-90803f901033 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:37.500043 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-053e09e3-d039-496d-a34c-90803f901033 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1556 microversion: 2.1 time: 0.178864 Jun 27 21:26:37.500851 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 494/1018] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:37 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1556 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:38.448061 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-fe5445e5-8240-4a02-a209-6bd236cffbb2 req-e55c5851-b4f0-4934-868d-e74f86e53648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d342f76-2548-4bed-8f8e-1b722c8e61e3", "name": "network-vif-deleted", "tag": "327711ca-a708-4b77-8455-a571c628332b"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:26:38.459457 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-fe5445e5-8240-4a02-a209-6bd236cffbb2 req-e55c5851-b4f0-4934-868d-e74f86e53648 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:38.459981 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-fe5445e5-8240-4a02-a209-6bd236cffbb2 req-e55c5851-b4f0-4934-868d-e74f86e53648 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:38.471891 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-fe5445e5-8240-4a02-a209-6bd236cffbb2 req-e55c5851-b4f0-4934-868d-e74f86e53648 service nova] Creating event network-vif-deleted:327711ca-a708-4b77-8455-a571c628332b for instance 3d342f76-2548-4bed-8f8e-1b722c8e61e3 on hv-cinder-84773 Jun 27 21:26:38.477457 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-fe5445e5-8240-4a02-a209-6bd236cffbb2 req-e55c5851-b4f0-4934-868d-e74f86e53648 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033054 Jun 27 21:26:38.478048 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 525/1019] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:26:38.519011 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cb7ae03e-2eaa-4f3b-a430-116545446378 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:38.519637 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cb7ae03e-2eaa-4f3b-a430-116545446378 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:38.527557 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb7ae03e-2eaa-4f3b-a430-116545446378 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:38.527995 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb7ae03e-2eaa-4f3b-a430-116545446378 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:38.528749 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb7ae03e-2eaa-4f3b-a430-116545446378 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:38.529201 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb7ae03e-2eaa-4f3b-a430-116545446378 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:38.600544 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cb7ae03e-2eaa-4f3b-a430-116545446378 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:38.608580 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cb7ae03e-2eaa-4f3b-a430-116545446378 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1514 microversion: 2.1 time: 0.093638 Jun 27 21:26:38.609219 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 495/1020] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:38 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1514 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:39.630350 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-34f50eec-b826-4eeb-93ef-edc9a71f6ba6 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:39.631052 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-34f50eec-b826-4eeb-93ef-edc9a71f6ba6 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:39.637943 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-34f50eec-b826-4eeb-93ef-edc9a71f6ba6 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:39.638390 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-34f50eec-b826-4eeb-93ef-edc9a71f6ba6 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:39.639149 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-34f50eec-b826-4eeb-93ef-edc9a71f6ba6 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:39.639581 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-34f50eec-b826-4eeb-93ef-edc9a71f6ba6 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:39.709463 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-34f50eec-b826-4eeb-93ef-edc9a71f6ba6 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:39.717320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-34f50eec-b826-4eeb-93ef-edc9a71f6ba6 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1514 microversion: 2.1 time: 0.093290 Jun 27 21:26:39.717891 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 526/1021] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:39 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1514 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:40.735774 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a675e3cd-f28a-4084-858b-8df4debf3fd2 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:40.736479 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a675e3cd-f28a-4084-858b-8df4debf3fd2 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:40.743080 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a675e3cd-f28a-4084-858b-8df4debf3fd2 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:40.743527 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a675e3cd-f28a-4084-858b-8df4debf3fd2 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:40.744299 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a675e3cd-f28a-4084-858b-8df4debf3fd2 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:40.744732 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a675e3cd-f28a-4084-858b-8df4debf3fd2 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:40.817275 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a675e3cd-f28a-4084-858b-8df4debf3fd2 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d867759b4f249a393598964774a22fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f86d6febe04e8f9745d787914b6d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:40.826118 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a675e3cd-f28a-4084-858b-8df4debf3fd2 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 200 len: 1344 microversion: 2.1 time: 0.094895 Jun 27 21:26:40.826800 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 496/1022] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:40 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 1344 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:41.844556 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e5479e60-a75f-441d-9ce4-8775fe38d689 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:41.845198 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e5479e60-a75f-441d-9ce4-8775fe38d689 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] [instance: 3d342f76-2548-4bed-8f8e-1b722c8e61e3] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:41.852579 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e5479e60-a75f-441d-9ce4-8775fe38d689 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:41.853098 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e5479e60-a75f-441d-9ce4-8775fe38d689 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:41.853867 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e5479e60-a75f-441d-9ce4-8775fe38d689 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:41.854300 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e5479e60-a75f-441d-9ce4-8775fe38d689 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:41.870282 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-e5479e60-a75f-441d-9ce4-8775fe38d689 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] HTTP exception thrown: Instance 3d342f76-2548-4bed-8f8e-1b722c8e61e3 could not be found. Jun 27 21:26:41.872070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e5479e60-a75f-441d-9ce4-8775fe38d689 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Request method failure captured: Jun 27 21:26:41.872070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 HTTP/1.1 Jun 27 21:26:41.872070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:26:41.872070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:26:41.872070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:26:41.872070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:26:41.872070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:26:41.872070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:26:41.872070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:26:41.872070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:26:41.872070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh_9QzCFgy-iAdml8pD7V9BzEjUWOVnef7sUA9oyTCqqnK__8eAIa9MBW7zO9HwgIx81a-KW7Hx30SvZq4OUaoNUV74tPe9hc3VkAkz0uzWCLPhecWzhEFZntlfaXpBXo-DraFZnKBlkDR6gSfotjHhTHBY6clUybBGg4XzI3SYqNXw Jun 27 21:26:41.872070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:26:41.872070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:26:41.872070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:26:41.872070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:26:41.872070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:26:41.872070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:26:41.872070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: c9f86d6febe04e8f9745d787914b6d5c Jun 27 21:26:41.872070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-TestMinimumBasicScenario-1239397201 Jun 27 21:26:41.872070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:26:41.872070 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:26:41.873838 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c9f86d6febe04e8f9745d787914b6d5c", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c9f86d6febe04e8f9745d787914b6d5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c9f86d6febe04e8f9745d787914b6d5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c9f86d6febe04e8f9745d787914b6d5c"}]}] Jun 27 21:26:41.873838 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-TestMinimumBasicScenario-1239397201 Jun 27 21:26:41.873838 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: c9f86d6febe04e8f9745d787914b6d5c Jun 27 21:26:41.873838 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1239397201 Jun 27 21:26:41.873838 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-TestMinimumBasicScenario-1239397201-project Jun 27 21:26:41.873838 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:26:41.873838 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:26:41.873838 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: 4d867759b4f249a393598964774a22fa Jun 27 21:26:41.873838 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-TestMinimumBasicScenario-1239397201-project Jun 27 21:26:41.873838 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: > Jun 27 21:26:41.873838 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Instance 3d342f76-2548-4bed-8f8e-1b722c8e61e3 could not be found. Jun 27 21:26:41.873838 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'id': '3d342f76-2548-4bed-8f8e-1b722c8e61e3'} Jun 27 21:26:41.874861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:26:41.874861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:26:41.874861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:26:41.874861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:26:41.874861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:26:41.874861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:26:41.874861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:26:41.874861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:26:41.874861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:26:41.874861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:26:41.874861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d342f76-2548-4bed-8f8e-1b722c8e61e3 could not be found. Jun 27 21:26:41.874861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:26:41.874861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:26:41.874861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:26:41.874861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:26:41.874861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:26:41.874861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:26:41.874861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:26:41.874861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:26:41.874861 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:26:41.876563 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:26:41.876563 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:26:41.876563 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:26:41.876563 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:26:41.876563 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:26:41.876563 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:26:41.876563 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:26:41.876563 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d342f76-2548-4bed-8f8e-1b722c8e61e3 could not be found. Jun 27 21:26:41.876563 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:26:41.876563 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:26:41.876563 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:26:41.876563 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:26:41.876563 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:26:41.876563 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:26:41.876563 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:26:41.876563 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:26:41.876563 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d342f76-2548-4bed-8f8e-1b722c8e61e3 could not be found. Jun 27 21:26:41.876563 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:26:41.878314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e5479e60-a75f-441d-9ce4-8775fe38d689 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Returning 404 to user: Instance 3d342f76-2548-4bed-8f8e-1b722c8e61e3 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:26:41.878314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e5479e60-a75f-441d-9ce4-8775fe38d689 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3" status: 404 len: 111 microversion: 2.1 time: 0.033947 Jun 27 21:26:41.878314 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 527/1023] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:41 2022] GET /compute/v2.1/servers/3d342f76-2548-4bed-8f8e-1b722c8e61e3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:26:41.885026 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-33be0c26-2ced-4a81-817f-374b22b90cc8 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] Calling method '.version_select at 0x7f83541c1160>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:41.905905 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-33be0c26-2ced-4a81-817f-374b22b90cc8 tempest-TestMinimumBasicScenario-1239397201 tempest-TestMinimumBasicScenario-1239397201-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1445052348" status: 202 len: 0 microversion: 2.1 time: 0.025732 Jun 27 21:26:41.906496 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 497/1024] 10.222.0.13 () {58 vars in 1271 bytes} [Mon Jun 27 21:26:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1445052348 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:26:44.871232 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6224f1da-abbe-4bc0-896c-09badf38ed43 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-191437393", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-621371235", "security_groups": [{"name": "tempest-secgroup-smoke-6158128"}], "block_device_mapping_v2": [{"uuid": "0d983eaf-91ee-45c9-b088-2ecce5262320", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "09838620-b3d2-4651-acb5-4212286d0e49"}]}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:26:44.994819 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.network.neutron [None req-6224f1da-abbe-4bc0-896c-09badf38ed43 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] validate_networks() for [('09838620-b3d2-4651-acb5-4212286d0e49', None, None, None, None, None)] {{(pid=117891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:26:45.416172 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-6224f1da-abbe-4bc0-896c-09badf38ed43 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Flavor limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:26:45.416855 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-6224f1da-abbe-4bc0-896c-09badf38ed43 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Image limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:26:45.417878 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-6224f1da-abbe-4bc0-896c-09badf38ed43 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Flavor pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:26:45.418447 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-6224f1da-abbe-4bc0-896c-09badf38ed43 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Image pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:26:45.419017 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-6224f1da-abbe-4bc0-896c-09badf38ed43 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:26:45.430095 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6224f1da-abbe-4bc0-896c-09badf38ed43 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:45.430699 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6224f1da-abbe-4bc0-896c-09badf38ed43 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:45.431329 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6224f1da-abbe-4bc0-896c-09badf38ed43 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:45.431751 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6224f1da-abbe-4bc0-896c-09badf38ed43 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:45.450894 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-6224f1da-abbe-4bc0-896c-09badf38ed43 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Getting quotas for project 824cb65198bf417fbc4baeae349d358d. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:26:45.457451 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-6224f1da-abbe-4bc0-896c-09badf38ed43 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Getting quotas for user e4b46dc825704fbc9cc2505805f22f94 and project 824cb65198bf417fbc4baeae349d358d. Resources: {'instances', 'ram', 'cores'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:26:45.534619 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6224f1da-abbe-4bc0-896c-09badf38ed43 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Going to run 1 instances... {{(pid=117891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:26:45.537400 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6224f1da-abbe-4bc0-896c-09badf38ed43 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: fafe275e-da1f-4c02-8e90-4fa623cb61ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0d983eaf-91ee-45c9-b088-2ecce5262320',volume_size=None,volume_type=None)] {{(pid=117891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:26:45.733341 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6224f1da-abbe-4bc0-896c-09badf38ed43 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.866506 Jun 27 21:26:45.744106 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8160d03b-b835-4e9d-abe1-0bcf112dd8b6 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:45.744730 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8160d03b-b835-4e9d-abe1-0bcf112dd8b6 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: fafe275e-da1f-4c02-8e90-4fa623cb61ff] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:45.748355 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 528/1025] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 27 21:26:44 2022] POST /compute/v2.1/servers => generated 403 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:26:45.886877 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8160d03b-b835-4e9d-abe1-0bcf112dd8b6 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:45.897607 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8160d03b-b835-4e9d-abe1-0bcf112dd8b6 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff" status: 200 len: 1093 microversion: 2.1 time: 0.156015 Jun 27 21:26:45.907778 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 498/1026] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:45 2022] GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff => generated 1093 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:46.916622 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-617be96f-55bc-40a7-8402-ff7178b7c695 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:46.917261 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-617be96f-55bc-40a7-8402-ff7178b7c695 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: fafe275e-da1f-4c02-8e90-4fa623cb61ff] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:46.924717 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-617be96f-55bc-40a7-8402-ff7178b7c695 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:46.925166 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-617be96f-55bc-40a7-8402-ff7178b7c695 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:46.926170 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-617be96f-55bc-40a7-8402-ff7178b7c695 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:46.926583 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-617be96f-55bc-40a7-8402-ff7178b7c695 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:47.013242 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-617be96f-55bc-40a7-8402-ff7178b7c695 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:47.032350 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-617be96f-55bc-40a7-8402-ff7178b7c695 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff" status: 200 len: 1199 microversion: 2.1 time: 0.120187 Jun 27 21:26:47.042930 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 529/1027] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:46 2022] GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff => generated 1199 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:48.050693 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b03fb362-fac1-4903-8db0-20337f06ea41 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:48.051340 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b03fb362-fac1-4903-8db0-20337f06ea41 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: fafe275e-da1f-4c02-8e90-4fa623cb61ff] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:48.058750 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b03fb362-fac1-4903-8db0-20337f06ea41 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:48.059434 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b03fb362-fac1-4903-8db0-20337f06ea41 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:48.060368 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b03fb362-fac1-4903-8db0-20337f06ea41 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:48.060996 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b03fb362-fac1-4903-8db0-20337f06ea41 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:48.376505 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b03fb362-fac1-4903-8db0-20337f06ea41 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:48.388230 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b03fb362-fac1-4903-8db0-20337f06ea41 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff" status: 200 len: 1262 microversion: 2.1 time: 0.341414 Jun 27 21:26:48.397150 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 499/1028] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:48 2022] GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff => generated 1262 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:49.040895 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-3096e869-0d71-4459-9e10-83f73f86f121 req-4aa23433-01c0-4a14-abd5-b3be7ec97078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fafe275e-da1f-4c02-8e90-4fa623cb61ff", "tag": "87b45f16-043c-40bf-b469-9fb57bd2be09"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:26:49.056268 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-3096e869-0d71-4459-9e10-83f73f86f121 req-4aa23433-01c0-4a14-abd5-b3be7ec97078 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:49.056701 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-3096e869-0d71-4459-9e10-83f73f86f121 req-4aa23433-01c0-4a14-abd5-b3be7ec97078 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:49.080049 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-3096e869-0d71-4459-9e10-83f73f86f121 req-4aa23433-01c0-4a14-abd5-b3be7ec97078 service nova] Creating event network-changed:87b45f16-043c-40bf-b469-9fb57bd2be09 for instance fafe275e-da1f-4c02-8e90-4fa623cb61ff on hv-cinder-84773 Jun 27 21:26:49.085951 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-3096e869-0d71-4459-9e10-83f73f86f121 req-4aa23433-01c0-4a14-abd5-b3be7ec97078 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049475 Jun 27 21:26:49.087159 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 530/1029] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:26:49.406778 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4de430b8-2698-4ad4-be74-efb0af286541 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:49.408172 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4de430b8-2698-4ad4-be74-efb0af286541 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: fafe275e-da1f-4c02-8e90-4fa623cb61ff] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:49.415745 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4de430b8-2698-4ad4-be74-efb0af286541 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:49.416541 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4de430b8-2698-4ad4-be74-efb0af286541 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:49.417001 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4de430b8-2698-4ad4-be74-efb0af286541 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:49.417412 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4de430b8-2698-4ad4-be74-efb0af286541 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:49.571332 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4de430b8-2698-4ad4-be74-efb0af286541 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:49.581351 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4de430b8-2698-4ad4-be74-efb0af286541 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff" status: 200 len: 1262 microversion: 2.1 time: 0.179469 Jun 27 21:26:49.593560 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 500/1030] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:49 2022] GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff => generated 1262 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:50.599619 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4e920702-c957-4060-9a00-b616f597428d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:50.600344 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4e920702-c957-4060-9a00-b616f597428d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: fafe275e-da1f-4c02-8e90-4fa623cb61ff] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:50.609162 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4e920702-c957-4060-9a00-b616f597428d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:50.609754 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4e920702-c957-4060-9a00-b616f597428d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:50.610527 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4e920702-c957-4060-9a00-b616f597428d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:50.610956 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4e920702-c957-4060-9a00-b616f597428d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:50.759967 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4e920702-c957-4060-9a00-b616f597428d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:50.770969 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4e920702-c957-4060-9a00-b616f597428d tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff" status: 200 len: 1262 microversion: 2.1 time: 0.175548 Jun 27 21:26:50.772079 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 531/1031] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:50 2022] GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff => generated 1262 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:26:51.788751 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9f51741e-5648-4bdf-bf2d-0b4cfb404b41 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:51.789392 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9f51741e-5648-4bdf-bf2d-0b4cfb404b41 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: fafe275e-da1f-4c02-8e90-4fa623cb61ff] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:51.797938 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9f51741e-5648-4bdf-bf2d-0b4cfb404b41 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:51.798385 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9f51741e-5648-4bdf-bf2d-0b4cfb404b41 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:51.799161 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9f51741e-5648-4bdf-bf2d-0b4cfb404b41 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:51.799600 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9f51741e-5648-4bdf-bf2d-0b4cfb404b41 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:51.936616 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9f51741e-5648-4bdf-bf2d-0b4cfb404b41 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:51.949720 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9f51741e-5648-4bdf-bf2d-0b4cfb404b41 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff" status: 200 len: 1262 microversion: 2.1 time: 0.164663 Jun 27 21:26:51.950347 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 501/1032] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:51 2022] GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff => generated 1262 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:52.970981 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ec0c924b-f422-428e-bc3d-3134c5da077e tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:52.971678 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ec0c924b-f422-428e-bc3d-3134c5da077e tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: fafe275e-da1f-4c02-8e90-4fa623cb61ff] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:52.978797 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ec0c924b-f422-428e-bc3d-3134c5da077e tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:52.979545 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ec0c924b-f422-428e-bc3d-3134c5da077e tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:52.980353 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ec0c924b-f422-428e-bc3d-3134c5da077e tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:52.980789 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ec0c924b-f422-428e-bc3d-3134c5da077e tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:53.134817 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ec0c924b-f422-428e-bc3d-3134c5da077e tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:53.145721 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ec0c924b-f422-428e-bc3d-3134c5da077e tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff" status: 200 len: 1262 microversion: 2.1 time: 0.178503 Jun 27 21:26:53.146456 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 532/1033] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:52 2022] GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff => generated 1262 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:54.167835 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-db8e2c96-0b2a-425b-88cb-f06dc032b2da tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:54.168472 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-db8e2c96-0b2a-425b-88cb-f06dc032b2da tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: fafe275e-da1f-4c02-8e90-4fa623cb61ff] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:54.175455 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db8e2c96-0b2a-425b-88cb-f06dc032b2da tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:54.175905 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db8e2c96-0b2a-425b-88cb-f06dc032b2da tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:54.176674 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db8e2c96-0b2a-425b-88cb-f06dc032b2da tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:54.177153 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db8e2c96-0b2a-425b-88cb-f06dc032b2da tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:54.636206 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-db8e2c96-0b2a-425b-88cb-f06dc032b2da tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:54.647555 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-db8e2c96-0b2a-425b-88cb-f06dc032b2da tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff" status: 200 len: 1262 microversion: 2.1 time: 0.483077 Jun 27 21:26:54.648444 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 502/1034] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:54 2022] GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff => generated 1262 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:55.671220 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-360ed74b-fc47-4b25-bf23-43fc705b40aa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:55.671823 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-360ed74b-fc47-4b25-bf23-43fc705b40aa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: fafe275e-da1f-4c02-8e90-4fa623cb61ff] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:55.674392 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:26:55.675054 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=6 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:26:55.681996 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-360ed74b-fc47-4b25-bf23-43fc705b40aa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:55.682567 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-360ed74b-fc47-4b25-bf23-43fc705b40aa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:55.683398 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-360ed74b-fc47-4b25-bf23-43fc705b40aa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:55.683829 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-360ed74b-fc47-4b25-bf23-43fc705b40aa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:55.824311 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-360ed74b-fc47-4b25-bf23-43fc705b40aa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:55.833115 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-360ed74b-fc47-4b25-bf23-43fc705b40aa tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff" status: 200 len: 1262 microversion: 2.1 time: 0.165926 Jun 27 21:26:55.833681 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 533/1035] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:55 2022] GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff => generated 1262 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:56.855576 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-72e7ab00-966e-4169-9a73-1721d9beead3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:56.856182 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-72e7ab00-966e-4169-9a73-1721d9beead3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: fafe275e-da1f-4c02-8e90-4fa623cb61ff] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:56.858474 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:26:56.864296 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-72e7ab00-966e-4169-9a73-1721d9beead3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:56.864746 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-72e7ab00-966e-4169-9a73-1721d9beead3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:56.865541 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-72e7ab00-966e-4169-9a73-1721d9beead3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:56.865975 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-72e7ab00-966e-4169-9a73-1721d9beead3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:57.001920 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-72e7ab00-966e-4169-9a73-1721d9beead3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:57.010037 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-72e7ab00-966e-4169-9a73-1721d9beead3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff" status: 200 len: 1262 microversion: 2.1 time: 0.158569 Jun 27 21:26:57.010599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 503/1036] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:56 2022] GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff => generated 1262 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:58.031299 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6f603fb5-6afa-42ea-abb8-02c68a8c645b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:58.032377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6f603fb5-6afa-42ea-abb8-02c68a8c645b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: fafe275e-da1f-4c02-8e90-4fa623cb61ff] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:58.041519 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6f603fb5-6afa-42ea-abb8-02c68a8c645b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:58.041964 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6f603fb5-6afa-42ea-abb8-02c68a8c645b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:58.042707 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6f603fb5-6afa-42ea-abb8-02c68a8c645b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:58.043151 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6f603fb5-6afa-42ea-abb8-02c68a8c645b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:58.200152 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-6f603fb5-6afa-42ea-abb8-02c68a8c645b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:58.210750 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6f603fb5-6afa-42ea-abb8-02c68a8c645b tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff" status: 200 len: 1262 microversion: 2.1 time: 0.184104 Jun 27 21:26:58.211636 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 534/1037] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:58 2022] GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff => generated 1262 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:59.200268 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-45c38d75-c1aa-4edd-8a23-2227ae41996a req-52d3000f-1ce8-4b3d-81e1-6b75bebb6686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafe275e-da1f-4c02-8e90-4fa623cb61ff", "name": "network-vif-plugged", "status": "completed", "tag": "87b45f16-043c-40bf-b469-9fb57bd2be09"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:26:59.212271 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-45c38d75-c1aa-4edd-8a23-2227ae41996a req-52d3000f-1ce8-4b3d-81e1-6b75bebb6686 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:59.212716 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-45c38d75-c1aa-4edd-8a23-2227ae41996a req-52d3000f-1ce8-4b3d-81e1-6b75bebb6686 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:59.224704 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-45c38d75-c1aa-4edd-8a23-2227ae41996a req-52d3000f-1ce8-4b3d-81e1-6b75bebb6686 service nova] Creating event network-vif-plugged:87b45f16-043c-40bf-b469-9fb57bd2be09 for instance fafe275e-da1f-4c02-8e90-4fa623cb61ff on hv-cinder-84773 Jun 27 21:26:59.228884 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f4f56f00-1f72-42a8-8814-1533f8bcf807 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:59.229646 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f4f56f00-1f72-42a8-8814-1533f8bcf807 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: fafe275e-da1f-4c02-8e90-4fa623cb61ff] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:59.230519 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-45c38d75-c1aa-4edd-8a23-2227ae41996a req-52d3000f-1ce8-4b3d-81e1-6b75bebb6686 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186471 Jun 27 21:26:59.231125 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 504/1038] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:26:59.236840 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f4f56f00-1f72-42a8-8814-1533f8bcf807 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:59.237376 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f4f56f00-1f72-42a8-8814-1533f8bcf807 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:59.238136 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f4f56f00-1f72-42a8-8814-1533f8bcf807 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:59.238561 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f4f56f00-1f72-42a8-8814-1533f8bcf807 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:59.377692 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f4f56f00-1f72-42a8-8814-1533f8bcf807 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:59.385884 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f4f56f00-1f72-42a8-8814-1533f8bcf807 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff" status: 200 len: 1262 microversion: 2.1 time: 0.161036 Jun 27 21:26:59.386461 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 535/1039] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:59 2022] GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff => generated 1262 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:27:00.406389 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b7ad68c2-31c3-4483-a410-0100c5a0afc9 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:00.407025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b7ad68c2-31c3-4483-a410-0100c5a0afc9 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: fafe275e-da1f-4c02-8e90-4fa623cb61ff] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:00.414681 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7ad68c2-31c3-4483-a410-0100c5a0afc9 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:00.415289 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7ad68c2-31c3-4483-a410-0100c5a0afc9 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:00.416131 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7ad68c2-31c3-4483-a410-0100c5a0afc9 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:00.416555 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7ad68c2-31c3-4483-a410-0100c5a0afc9 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:00.565353 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b7ad68c2-31c3-4483-a410-0100c5a0afc9 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:27:00.574954 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b7ad68c2-31c3-4483-a410-0100c5a0afc9 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff" status: 200 len: 1262 microversion: 2.1 time: 0.173827 Jun 27 21:27:00.575616 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 505/1040] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:27:00 2022] GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff => generated 1262 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:27:01.593278 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-62067927-88f6-41b7-8a41-628b9d151e63 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:01.593920 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-62067927-88f6-41b7-8a41-628b9d151e63 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: fafe275e-da1f-4c02-8e90-4fa623cb61ff] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:01.601791 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-62067927-88f6-41b7-8a41-628b9d151e63 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:01.602355 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-62067927-88f6-41b7-8a41-628b9d151e63 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:01.603198 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-62067927-88f6-41b7-8a41-628b9d151e63 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:01.603655 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-62067927-88f6-41b7-8a41-628b9d151e63 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:01.743755 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-62067927-88f6-41b7-8a41-628b9d151e63 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:27:01.746145 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:27:01.752548 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-62067927-88f6-41b7-8a41-628b9d151e63 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff" status: 200 len: 1448 microversion: 2.1 time: 0.163290 Jun 27 21:27:01.753160 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 536/1041] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:27:01 2022] GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff => generated 1448 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:27:01.769167 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7b8c7323-04c3-47b2-bf81-7eb8236e1315 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:01.769779 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7b8c7323-04c3-47b2-bf81-7eb8236e1315 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: fafe275e-da1f-4c02-8e90-4fa623cb61ff] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:01.776679 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b8c7323-04c3-47b2-bf81-7eb8236e1315 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:01.777149 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b8c7323-04c3-47b2-bf81-7eb8236e1315 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:01.777903 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b8c7323-04c3-47b2-bf81-7eb8236e1315 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:01.778332 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b8c7323-04c3-47b2-bf81-7eb8236e1315 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:01.942444 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7b8c7323-04c3-47b2-bf81-7eb8236e1315 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:27:01.952287 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7b8c7323-04c3-47b2-bf81-7eb8236e1315 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff" status: 200 len: 1448 microversion: 2.1 time: 0.187048 Jun 27 21:27:01.953289 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 506/1042] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:27:01 2022] GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff => generated 1448 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:27:03.885969 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-afc989c7-f74e-406b-9501-fa7d6d69bbde req-21bd10dd-2e7f-4ffa-83d2-0adf668b410b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fafe275e-da1f-4c02-8e90-4fa623cb61ff", "tag": "87b45f16-043c-40bf-b469-9fb57bd2be09"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:27:03.891433 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:27:03.896082 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-afc989c7-f74e-406b-9501-fa7d6d69bbde req-21bd10dd-2e7f-4ffa-83d2-0adf668b410b service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:03.896751 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-afc989c7-f74e-406b-9501-fa7d6d69bbde req-21bd10dd-2e7f-4ffa-83d2-0adf668b410b service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:03.909577 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-afc989c7-f74e-406b-9501-fa7d6d69bbde req-21bd10dd-2e7f-4ffa-83d2-0adf668b410b service nova] Creating event network-changed:87b45f16-043c-40bf-b469-9fb57bd2be09 for instance fafe275e-da1f-4c02-8e90-4fa623cb61ff on hv-cinder-84773 Jun 27 21:27:03.914716 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-afc989c7-f74e-406b-9501-fa7d6d69bbde req-21bd10dd-2e7f-4ffa-83d2-0adf668b410b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032795 Jun 27 21:27:03.915307 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 537/1043] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:27:46.164846 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 21:27:46.165632 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Mon Jun 27 21:27:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 21:28:32.232752 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9cd3589c-4334-410c-93f9-fe4f0347fa1c tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:32.234767 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9cd3589c-4334-410c-93f9-fe4f0347fa1c tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: fafe275e-da1f-4c02-8e90-4fa623cb61ff] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:32.236982 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=3 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:28:32.239057 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:28:32.241978 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:28:32.243569 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:28:32.250908 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9cd3589c-4334-410c-93f9-fe4f0347fa1c tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:32.251370 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9cd3589c-4334-410c-93f9-fe4f0347fa1c tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:32.252180 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9cd3589c-4334-410c-93f9-fe4f0347fa1c tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:32.252596 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9cd3589c-4334-410c-93f9-fe4f0347fa1c tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:32.285679 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9cd3589c-4334-410c-93f9-fe4f0347fa1c tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: fafe275e-da1f-4c02-8e90-4fa623cb61ff] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:28:32.359256 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-b82624f8-b9c5-445a-bb6c-2298b8c85b6c req-35e98077-aefa-45d5-ac85-75dfddf5f181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fafe275e-da1f-4c02-8e90-4fa623cb61ff", "tag": "87b45f16-043c-40bf-b469-9fb57bd2be09"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:28:32.369462 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-b82624f8-b9c5-445a-bb6c-2298b8c85b6c req-35e98077-aefa-45d5-ac85-75dfddf5f181 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:32.369903 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-b82624f8-b9c5-445a-bb6c-2298b8c85b6c req-35e98077-aefa-45d5-ac85-75dfddf5f181 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:32.383432 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-b82624f8-b9c5-445a-bb6c-2298b8c85b6c req-35e98077-aefa-45d5-ac85-75dfddf5f181 service nova] Creating event network-changed:87b45f16-043c-40bf-b469-9fb57bd2be09 for instance fafe275e-da1f-4c02-8e90-4fa623cb61ff on hv-cinder-84773 Jun 27 21:28:32.390377 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-b82624f8-b9c5-445a-bb6c-2298b8c85b6c req-35e98077-aefa-45d5-ac85-75dfddf5f181 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156806 Jun 27 21:28:32.391386 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 538/1044] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:28:32.410931 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9cd3589c-4334-410c-93f9-fe4f0347fa1c tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff" status: 204 len: 0 microversion: 2.1 time: 0.184212 Jun 27 21:28:32.411820 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 507/1045] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:28:32 2022] DELETE /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 21:28:32.426587 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-114dcdc4-8132-4225-99f2-9c046cbc2dcf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:32.427752 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-114dcdc4-8132-4225-99f2-9c046cbc2dcf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: fafe275e-da1f-4c02-8e90-4fa623cb61ff] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:32.434642 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-114dcdc4-8132-4225-99f2-9c046cbc2dcf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:32.435173 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-114dcdc4-8132-4225-99f2-9c046cbc2dcf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:32.436298 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-114dcdc4-8132-4225-99f2-9c046cbc2dcf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:32.436736 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-114dcdc4-8132-4225-99f2-9c046cbc2dcf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:32.635501 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-114dcdc4-8132-4225-99f2-9c046cbc2dcf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:28:32.644800 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-114dcdc4-8132-4225-99f2-9c046cbc2dcf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff" status: 200 len: 1573 microversion: 2.1 time: 0.222629 Jun 27 21:28:32.645493 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 539/1046] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:28:32 2022] GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff => generated 1573 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:28:33.664528 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7d184f89-1866-4d00-bd63-7affc2d97678 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:33.665379 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7d184f89-1866-4d00-bd63-7affc2d97678 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: fafe275e-da1f-4c02-8e90-4fa623cb61ff] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:33.674845 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d184f89-1866-4d00-bd63-7affc2d97678 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:33.675357 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d184f89-1866-4d00-bd63-7affc2d97678 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:33.676148 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d184f89-1866-4d00-bd63-7affc2d97678 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:33.676593 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d184f89-1866-4d00-bd63-7affc2d97678 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:33.879825 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7d184f89-1866-4d00-bd63-7affc2d97678 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:28:33.890032 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7d184f89-1866-4d00-bd63-7affc2d97678 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff" status: 200 len: 1573 microversion: 2.1 time: 0.230010 Jun 27 21:28:33.890647 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 508/1047] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:28:33 2022] GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff => generated 1573 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:28:34.909353 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d99d1606-7e7b-43aa-93ee-d518d83a63cf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:34.911749 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d99d1606-7e7b-43aa-93ee-d518d83a63cf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: fafe275e-da1f-4c02-8e90-4fa623cb61ff] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:34.920267 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d99d1606-7e7b-43aa-93ee-d518d83a63cf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:34.921016 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d99d1606-7e7b-43aa-93ee-d518d83a63cf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:34.922660 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d99d1606-7e7b-43aa-93ee-d518d83a63cf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:34.924105 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d99d1606-7e7b-43aa-93ee-d518d83a63cf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:35.024841 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d99d1606-7e7b-43aa-93ee-d518d83a63cf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:28:35.039698 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d99d1606-7e7b-43aa-93ee-d518d83a63cf tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff" status: 200 len: 1224 microversion: 2.1 time: 0.135120 Jun 27 21:28:35.041460 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 509/1048] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:28:34 2022] GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff => generated 1224 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:28:35.062700 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-d77d63cb-5b31-4823-8bcc-54bdfc2c50e3 req-2eb51ae7-4cf2-4678-87f9-a2099d641c34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafe275e-da1f-4c02-8e90-4fa623cb61ff", "name": "network-vif-deleted", "tag": "87b45f16-043c-40bf-b469-9fb57bd2be09"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:28:35.072806 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-d77d63cb-5b31-4823-8bcc-54bdfc2c50e3 req-2eb51ae7-4cf2-4678-87f9-a2099d641c34 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:35.073676 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-d77d63cb-5b31-4823-8bcc-54bdfc2c50e3 req-2eb51ae7-4cf2-4678-87f9-a2099d641c34 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:35.093150 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-d77d63cb-5b31-4823-8bcc-54bdfc2c50e3 req-2eb51ae7-4cf2-4678-87f9-a2099d641c34 service nova] Creating event network-vif-deleted:87b45f16-043c-40bf-b469-9fb57bd2be09 for instance fafe275e-da1f-4c02-8e90-4fa623cb61ff on hv-cinder-84773 Jun 27 21:28:35.098632 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-d77d63cb-5b31-4823-8bcc-54bdfc2c50e3 req-2eb51ae7-4cf2-4678-87f9-a2099d641c34 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221196 Jun 27 21:28:35.099248 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 540/1049] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:28:36.068431 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d9c8151f-68be-49ac-9640-913570771fa3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:36.069482 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d9c8151f-68be-49ac-9640-913570771fa3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: fafe275e-da1f-4c02-8e90-4fa623cb61ff] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:36.078413 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d9c8151f-68be-49ac-9640-913570771fa3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:36.079000 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d9c8151f-68be-49ac-9640-913570771fa3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:36.080116 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d9c8151f-68be-49ac-9640-913570771fa3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:36.080672 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d9c8151f-68be-49ac-9640-913570771fa3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:36.097445 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-d9c8151f-68be-49ac-9640-913570771fa3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] HTTP exception thrown: Instance fafe275e-da1f-4c02-8e90-4fa623cb61ff could not be found. Jun 27 21:28:36.099254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d9c8151f-68be-49ac-9640-913570771fa3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Request method failure captured: Jun 27 21:28:36.099254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff HTTP/1.1 Jun 27 21:28:36.099254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:28:36.099254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:28:36.099254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:28:36.099254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:28:36.099254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:28:36.099254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:28:36.099254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:28:36.099254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:28:36.099254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh9rBsXSISnkHy1jQit7xxhIkHj3UUTjTB0I8A21_aXJSQH1lsks8aurzJj6WR6bQ0Nf7CesV-aeeYKUP4_jdnhcNTHfuJ_kUfgVnKj466W12TCu5UJtv8DFApLsNt6LycoT4CuxfaZ_WKdfxtaLe1y1sANZzTESByabMYXXSip-mj8 Jun 27 21:28:36.099254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:28:36.099254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:28:36.099254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:28:36.099254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:28:36.099254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:28:36.099254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:28:36.099254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 824cb65198bf417fbc4baeae349d358d Jun 27 21:28:36.099254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-TestVolumeBootPattern-1678295548 Jun 27 21:28:36.099254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:28:36.099254 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:28:36.101869 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_824cb65198bf417fbc4baeae349d358d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/824cb65198bf417fbc4baeae349d358d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/824cb65198bf417fbc4baeae349d358d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/824cb65198bf417fbc4baeae349d358d"}]}] Jun 27 21:28:36.101869 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-TestVolumeBootPattern-1678295548 Jun 27 21:28:36.101869 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 824cb65198bf417fbc4baeae349d358d Jun 27 21:28:36.101869 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-TestVolumeBootPattern-1678295548 Jun 27 21:28:36.101869 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-TestVolumeBootPattern-1678295548-project Jun 27 21:28:36.101869 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:28:36.101869 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:28:36.101869 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: e4b46dc825704fbc9cc2505805f22f94 Jun 27 21:28:36.101869 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-TestVolumeBootPattern-1678295548-project Jun 27 21:28:36.101869 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:28:36.101869 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance fafe275e-da1f-4c02-8e90-4fa623cb61ff could not be found. Jun 27 21:28:36.101869 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': 'fafe275e-da1f-4c02-8e90-4fa623cb61ff'} Jun 27 21:28:36.103301 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:28:36.103301 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:36.103301 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:28:36.103301 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:28:36.103301 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:28:36.103301 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:28:36.103301 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:28:36.103301 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:28:36.103301 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:28:36.103301 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:28:36.103301 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fafe275e-da1f-4c02-8e90-4fa623cb61ff could not be found. Jun 27 21:28:36.103301 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:28:36.103301 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:36.103301 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:28:36.103301 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:36.103301 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:36.103301 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:36.103301 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:28:36.103301 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:28:36.103301 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:28:36.106224 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:28:36.106224 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:28:36.106224 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:28:36.106224 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:28:36.106224 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:28:36.106224 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:28:36.106224 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:28:36.106224 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fafe275e-da1f-4c02-8e90-4fa623cb61ff could not be found. Jun 27 21:28:36.106224 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:28:36.106224 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:36.106224 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:28:36.106224 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:36.106224 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:36.106224 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:36.106224 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:28:36.106224 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:28:36.106224 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fafe275e-da1f-4c02-8e90-4fa623cb61ff could not be found. Jun 27 21:28:36.106224 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:28:36.109108 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d9c8151f-68be-49ac-9640-913570771fa3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Returning 404 to user: Instance fafe275e-da1f-4c02-8e90-4fa623cb61ff could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:28:36.109108 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d9c8151f-68be-49ac-9640-913570771fa3 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff" status: 404 len: 111 microversion: 2.1 time: 0.036546 Jun 27 21:28:36.109108 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 510/1050] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:28:36 2022] GET /compute/v2.1/servers/fafe275e-da1f-4c02-8e90-4fa623cb61ff => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:28:39.404404 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-53460cbb-d272-4f9a-997e-7bd4b89b2160 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:39.405747 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-53460cbb-d272-4f9a-997e-7bd4b89b2160 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:39.412337 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-9ca54906-f946-476b-bf94-4efdd8952fb7 req-b1a59fdb-6bb4-40dc-9c46-7e25a39e0a19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a7e5b75-82ca-47af-a6cd-41fe4b7b3453", "tag": "fe53f861-c6c2-4087-a223-4e44a93bac65"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:28:39.418334 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-53460cbb-d272-4f9a-997e-7bd4b89b2160 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:39.420082 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-53460cbb-d272-4f9a-997e-7bd4b89b2160 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:39.421920 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-53460cbb-d272-4f9a-997e-7bd4b89b2160 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:39.422641 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-53460cbb-d272-4f9a-997e-7bd4b89b2160 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:39.427615 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-9ca54906-f946-476b-bf94-4efdd8952fb7 req-b1a59fdb-6bb4-40dc-9c46-7e25a39e0a19 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:39.428512 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-9ca54906-f946-476b-bf94-4efdd8952fb7 req-b1a59fdb-6bb4-40dc-9c46-7e25a39e0a19 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:39.448940 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-9ca54906-f946-476b-bf94-4efdd8952fb7 req-b1a59fdb-6bb4-40dc-9c46-7e25a39e0a19 service nova] Creating event network-changed:fe53f861-c6c2-4087-a223-4e44a93bac65 for instance 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 on hv-cinder-84773 Jun 27 21:28:39.457866 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-9ca54906-f946-476b-bf94-4efdd8952fb7 req-b1a59fdb-6bb4-40dc-9c46-7e25a39e0a19 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053479 Jun 27 21:28:39.459230 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 511/1051] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:28:39.472225 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-53460cbb-d272-4f9a-997e-7bd4b89b2160 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] Going to try to terminate instance {{(pid=117891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:28:39.615642 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-53460cbb-d272-4f9a-997e-7bd4b89b2160 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453" status: 204 len: 0 microversion: 2.1 time: 0.215279 Jun 27 21:28:39.618328 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 541/1052] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:28:39 2022] DELETE /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:28:39.634242 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d0885af4-8a7b-4e4e-ac8c-688ec92519c1 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:39.635731 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d0885af4-8a7b-4e4e-ac8c-688ec92519c1 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:39.649625 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d0885af4-8a7b-4e4e-ac8c-688ec92519c1 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:39.650574 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d0885af4-8a7b-4e4e-ac8c-688ec92519c1 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:39.652439 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d0885af4-8a7b-4e4e-ac8c-688ec92519c1 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:39.653770 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d0885af4-8a7b-4e4e-ac8c-688ec92519c1 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:39.881432 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d0885af4-8a7b-4e4e-ac8c-688ec92519c1 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:28:39.893061 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d0885af4-8a7b-4e4e-ac8c-688ec92519c1 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453" status: 200 len: 1575 microversion: 2.1 time: 0.267433 Jun 27 21:28:39.893874 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 512/1053] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:28:39 2022] GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 => generated 1575 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:28:40.923128 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3b67bbb0-4811-452d-96ca-50e04aa8fc17 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:40.924591 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3b67bbb0-4811-452d-96ca-50e04aa8fc17 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:40.938249 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3b67bbb0-4811-452d-96ca-50e04aa8fc17 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:40.939284 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3b67bbb0-4811-452d-96ca-50e04aa8fc17 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:40.940831 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3b67bbb0-4811-452d-96ca-50e04aa8fc17 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:40.941706 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3b67bbb0-4811-452d-96ca-50e04aa8fc17 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:41.154393 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3b67bbb0-4811-452d-96ca-50e04aa8fc17 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:28:41.168983 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3b67bbb0-4811-452d-96ca-50e04aa8fc17 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453" status: 200 len: 1575 microversion: 2.1 time: 0.254600 Jun 27 21:28:41.170537 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 542/1054] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:28:40 2022] GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 => generated 1575 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:28:42.141753 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-03f0a922-1c3f-4d09-ac3a-61d47b633568 req-5d43be02-057e-419d-9f5f-6010292d17f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a7e5b75-82ca-47af-a6cd-41fe4b7b3453", "name": "network-vif-deleted", "tag": "fe53f861-c6c2-4087-a223-4e44a93bac65"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:28:42.153814 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-03f0a922-1c3f-4d09-ac3a-61d47b633568 req-5d43be02-057e-419d-9f5f-6010292d17f3 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:42.154320 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-03f0a922-1c3f-4d09-ac3a-61d47b633568 req-5d43be02-057e-419d-9f5f-6010292d17f3 service nova] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:42.172486 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-03f0a922-1c3f-4d09-ac3a-61d47b633568 req-5d43be02-057e-419d-9f5f-6010292d17f3 service nova] Creating event network-vif-deleted:fe53f861-c6c2-4087-a223-4e44a93bac65 for instance 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 on hv-cinder-84773 Jun 27 21:28:42.181323 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-03f0a922-1c3f-4d09-ac3a-61d47b633568 req-5d43be02-057e-419d-9f5f-6010292d17f3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046864 Jun 27 21:28:42.182159 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 513/1055] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 27 21:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:28:42.189754 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-155b2f29-7349-4d7f-b291-316d8da755b4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:42.191052 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-155b2f29-7349-4d7f-b291-316d8da755b4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:42.197955 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-155b2f29-7349-4d7f-b291-316d8da755b4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:42.198393 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-155b2f29-7349-4d7f-b291-316d8da755b4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:42.199186 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-155b2f29-7349-4d7f-b291-316d8da755b4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:42.199624 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-155b2f29-7349-4d7f-b291-316d8da755b4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:42.304585 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-155b2f29-7349-4d7f-b291-316d8da755b4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b46dc825704fbc9cc2505805f22f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824cb65198bf417fbc4baeae349d358d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:28:42.313677 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-155b2f29-7349-4d7f-b291-316d8da755b4 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453" status: 200 len: 1225 microversion: 2.1 time: 0.129126 Jun 27 21:28:42.314254 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 543/1056] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:28:42 2022] GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 => generated 1225 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:28:43.336348 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e457fe22-bb47-4400-b236-df9196c81422 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:43.338960 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e457fe22-bb47-4400-b236-df9196c81422 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:43.350416 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e457fe22-bb47-4400-b236-df9196c81422 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:43.351190 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e457fe22-bb47-4400-b236-df9196c81422 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:43.352569 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e457fe22-bb47-4400-b236-df9196c81422 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:43.353364 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e457fe22-bb47-4400-b236-df9196c81422 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:43.384865 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-e457fe22-bb47-4400-b236-df9196c81422 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] HTTP exception thrown: Instance 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 could not be found. Jun 27 21:28:43.387599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e457fe22-bb47-4400-b236-df9196c81422 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Request method failure captured: Jun 27 21:28:43.387599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 HTTP/1.1 Jun 27 21:28:43.387599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:28:43.387599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:28:43.387599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:28:43.387599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:28:43.387599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:28:43.387599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:28:43.387599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:28:43.387599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:28:43.387599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh9rBsXSISnkHy1jQit7xxhIkHj3UUTjTB0I8A21_aXJSQH1lsks8aurzJj6WR6bQ0Nf7CesV-aeeYKUP4_jdnhcNTHfuJ_kUfgVnKj466W12TCu5UJtv8DFApLsNt6LycoT4CuxfaZ_WKdfxtaLe1y1sANZzTESByabMYXXSip-mj8 Jun 27 21:28:43.387599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:28:43.387599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:28:43.387599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:28:43.387599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:28:43.387599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:28:43.387599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:28:43.387599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 824cb65198bf417fbc4baeae349d358d Jun 27 21:28:43.387599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-TestVolumeBootPattern-1678295548 Jun 27 21:28:43.387599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:28:43.387599 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:28:43.390685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_824cb65198bf417fbc4baeae349d358d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/824cb65198bf417fbc4baeae349d358d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/824cb65198bf417fbc4baeae349d358d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/824cb65198bf417fbc4baeae349d358d"}]}] Jun 27 21:28:43.390685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-TestVolumeBootPattern-1678295548 Jun 27 21:28:43.390685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 824cb65198bf417fbc4baeae349d358d Jun 27 21:28:43.390685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-TestVolumeBootPattern-1678295548 Jun 27 21:28:43.390685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-TestVolumeBootPattern-1678295548-project Jun 27 21:28:43.390685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:28:43.390685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:28:43.390685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: e4b46dc825704fbc9cc2505805f22f94 Jun 27 21:28:43.390685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-TestVolumeBootPattern-1678295548-project Jun 27 21:28:43.390685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:28:43.390685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 could not be found. Jun 27 21:28:43.390685 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '8a7e5b75-82ca-47af-a6cd-41fe4b7b3453'} Jun 27 21:28:43.393404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:28:43.393404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:43.393404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:28:43.393404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:28:43.393404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:28:43.393404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:28:43.393404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:28:43.393404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:28:43.393404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:28:43.393404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:28:43.393404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 could not be found. Jun 27 21:28:43.393404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:28:43.393404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:43.393404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:28:43.393404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:43.393404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:43.393404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:43.393404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:28:43.393404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:28:43.393404 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:28:43.395936 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:28:43.395936 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:28:43.395936 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:28:43.395936 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:28:43.395936 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:28:43.395936 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:28:43.395936 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:28:43.395936 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 could not be found. Jun 27 21:28:43.395936 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:28:43.395936 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:43.395936 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:28:43.395936 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:43.395936 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:43.395936 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:43.395936 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:28:43.395936 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:28:43.395936 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 could not be found. Jun 27 21:28:43.395936 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:28:43.398706 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e457fe22-bb47-4400-b236-df9196c81422 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Returning 404 to user: Instance 8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:28:43.398706 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e457fe22-bb47-4400-b236-df9196c81422 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453" status: 404 len: 111 microversion: 2.1 time: 0.062722 Jun 27 21:28:43.398706 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 514/1057] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:28:43 2022] GET /compute/v2.1/servers/8a7e5b75-82ca-47af-a6cd-41fe4b7b3453 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:28:43.954892 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-26895b95-38c2-46ae-909e-d9756c8e7a85 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:43.955626 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-26895b95-38c2-46ae-909e-d9756c8e7a85 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:43.962666 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-26895b95-38c2-46ae-909e-d9756c8e7a85 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:43.963176 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-26895b95-38c2-46ae-909e-d9756c8e7a85 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:43.964068 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-26895b95-38c2-46ae-909e-d9756c8e7a85 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:43.964625 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-26895b95-38c2-46ae-909e-d9756c8e7a85 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:43.981234 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-26895b95-38c2-46ae-909e-d9756c8e7a85 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] HTTP exception thrown: Instance 0641e731-c003-43d1-93c6-072ca2542d9f could not be found. Jun 27 21:28:43.983320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-26895b95-38c2-46ae-909e-d9756c8e7a85 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Request method failure captured: Jun 27 21:28:43.983320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: request: DELETE /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f HTTP/1.1 Jun 27 21:28:43.983320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 27 21:28:43.983320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 27 21:28:43.983320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Connection: close Jun 27 21:28:43.983320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 27 21:28:43.983320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 27 21:28:43.983320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Host: 10.222.0.13 Jun 27 21:28:43.983320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 27 21:28:43.983320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 27 21:28:43.983320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABiuh9rBsXSISnkHy1jQit7xxhIkHj3UUTjTB0I8A21_aXJSQH1lsks8aurzJj6WR6bQ0Nf7CesV-aeeYKUP4_jdnhcNTHfuJ_kUfgVnKj466W12TCu5UJtv8DFApLsNt6LycoT4CuxfaZ_WKdfxtaLe1y1sANZzTESByabMYXXSip-mj8 Jun 27 21:28:43.983320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 27 21:28:43.983320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 27 21:28:43.983320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 27 21:28:43.983320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 27 21:28:43.983320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 27 21:28:43.983320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 27 21:28:43.983320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Id: 824cb65198bf417fbc4baeae349d358d Jun 27 21:28:43.983320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-TestVolumeBootPattern-1678295548 Jun 27 21:28:43.983320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Role: member,reader Jun 27 21:28:43.983320 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Roles: member,reader Jun 27 21:28:43.985780 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_824cb65198bf417fbc4baeae349d358d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/824cb65198bf417fbc4baeae349d358d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/824cb65198bf417fbc4baeae349d358d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/824cb65198bf417fbc4baeae349d358d"}]}] Jun 27 21:28:43.985780 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-TestVolumeBootPattern-1678295548 Jun 27 21:28:43.985780 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 824cb65198bf417fbc4baeae349d358d Jun 27 21:28:43.985780 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-TestVolumeBootPattern-1678295548 Jun 27 21:28:43.985780 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User: tempest-TestVolumeBootPattern-1678295548-project Jun 27 21:28:43.985780 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 27 21:28:43.985780 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 27 21:28:43.985780 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Id: e4b46dc825704fbc9cc2505805f22f94 Jun 27 21:28:43.985780 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-TestVolumeBootPattern-1678295548-project Jun 27 21:28:43.985780 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: method: > Jun 27 21:28:43.985780 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: exception: Instance 0641e731-c003-43d1-93c6-072ca2542d9f could not be found. Jun 27 21:28:43.985780 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: action_args: {'id': '0641e731-c003-43d1-93c6-072ca2542d9f'} Jun 27 21:28:43.987237 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:28:43.987237 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:43.987237 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:28:43.987237 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:28:43.987237 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:28:43.987237 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:28:43.987237 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:28:43.987237 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:28:43.987237 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:28:43.987237 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:28:43.987237 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0641e731-c003-43d1-93c6-072ca2542d9f could not be found. Jun 27 21:28:43.987237 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:28:43.987237 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:43.987237 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:28:43.987237 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:43.987237 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:43.987237 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:43.987237 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:28:43.987237 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:28:43.987237 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:28:43.988549 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:28:43.988549 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 21:28:43.988549 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 21:28:43.988549 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 21:28:43.988549 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 21:28:43.988549 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:28:43.988549 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:28:43.988549 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:28:43.988549 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:28:43.988549 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0641e731-c003-43d1-93c6-072ca2542d9f could not be found. Jun 27 21:28:43.988549 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:28:43.988549 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:43.988549 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:28:43.988549 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:43.988549 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:43.988549 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:43.988549 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:28:43.988549 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:28:43.988549 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0641e731-c003-43d1-93c6-072ca2542d9f could not be found. Jun 27 21:28:43.988549 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 27 21:28:43.990097 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-26895b95-38c2-46ae-909e-d9756c8e7a85 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Returning 404 to user: Instance 0641e731-c003-43d1-93c6-072ca2542d9f could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:28:43.990097 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-26895b95-38c2-46ae-909e-d9756c8e7a85 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 404 len: 111 microversion: 2.1 time: 0.035025 Jun 27 21:28:43.990097 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 544/1058] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 27 21:28:43 2022] DELETE /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:28:43.999789 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6a6a3f07-f433-4616-ab6d-0f3b127ea378 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:44.000671 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6a6a3f07-f433-4616-ab6d-0f3b127ea378 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] [instance: 0641e731-c003-43d1-93c6-072ca2542d9f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:44.012171 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6a6a3f07-f433-4616-ab6d-0f3b127ea378 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:44.013103 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6a6a3f07-f433-4616-ab6d-0f3b127ea378 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:44.014536 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6a6a3f07-f433-4616-ab6d-0f3b127ea378 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:44.015304 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6a6a3f07-f433-4616-ab6d-0f3b127ea378 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Lock "9a1fe3d3-e727-4f8a-bdfc-0659bc10e814" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:44.042905 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-6a6a3f07-f433-4616-ab6d-0f3b127ea378 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] HTTP exception thrown: Instance 0641e731-c003-43d1-93c6-072ca2542d9f could not be found. Jun 27 21:28:44.046039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6a6a3f07-f433-4616-ab6d-0f3b127ea378 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Request method failure captured: Jun 27 21:28:44.046039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f HTTP/1.1 Jun 27 21:28:44.046039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 27 21:28:44.046039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 27 21:28:44.046039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 27 21:28:44.046039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 27 21:28:44.046039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 27 21:28:44.046039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.13 Jun 27 21:28:44.046039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 27 21:28:44.046039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 27 21:28:44.046039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuh9rBsXSISnkHy1jQit7xxhIkHj3UUTjTB0I8A21_aXJSQH1lsks8aurzJj6WR6bQ0Nf7CesV-aeeYKUP4_jdnhcNTHfuJ_kUfgVnKj466W12TCu5UJtv8DFApLsNt6LycoT4CuxfaZ_WKdfxtaLe1y1sANZzTESByabMYXXSip-mj8 Jun 27 21:28:44.046039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 27 21:28:44.046039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 27 21:28:44.046039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 27 21:28:44.046039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 27 21:28:44.046039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 27 21:28:44.046039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 27 21:28:44.046039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 824cb65198bf417fbc4baeae349d358d Jun 27 21:28:44.046039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-TestVolumeBootPattern-1678295548 Jun 27 21:28:44.046039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 27 21:28:44.046039 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 27 21:28:44.047742 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_824cb65198bf417fbc4baeae349d358d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/824cb65198bf417fbc4baeae349d358d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/824cb65198bf417fbc4baeae349d358d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/824cb65198bf417fbc4baeae349d358d"}]}] Jun 27 21:28:44.047742 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-TestVolumeBootPattern-1678295548 Jun 27 21:28:44.047742 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 824cb65198bf417fbc4baeae349d358d Jun 27 21:28:44.047742 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-TestVolumeBootPattern-1678295548 Jun 27 21:28:44.047742 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User: tempest-TestVolumeBootPattern-1678295548-project Jun 27 21:28:44.047742 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 27 21:28:44.047742 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 27 21:28:44.047742 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Id: e4b46dc825704fbc9cc2505805f22f94 Jun 27 21:28:44.047742 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-TestVolumeBootPattern-1678295548-project Jun 27 21:28:44.047742 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: method: > Jun 27 21:28:44.047742 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: exception: Instance 0641e731-c003-43d1-93c6-072ca2542d9f could not be found. Jun 27 21:28:44.047742 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '0641e731-c003-43d1-93c6-072ca2542d9f'} Jun 27 21:28:44.048587 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:28:44.048587 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:44.048587 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:28:44.048587 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:28:44.048587 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:28:44.048587 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:28:44.048587 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:28:44.048587 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:28:44.048587 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:28:44.048587 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:28:44.048587 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0641e731-c003-43d1-93c6-072ca2542d9f could not be found. Jun 27 21:28:44.048587 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:28:44.048587 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:44.048587 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:28:44.048587 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:44.048587 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:44.048587 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:44.048587 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:28:44.048587 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:28:44.048587 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:28:44.050025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:28:44.050025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:28:44.050025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:28:44.050025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:28:44.050025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:28:44.050025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:28:44.050025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:28:44.050025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0641e731-c003-43d1-93c6-072ca2542d9f could not be found. Jun 27 21:28:44.050025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:28:44.050025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:44.050025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:28:44.050025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:44.050025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:44.050025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:44.050025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:28:44.050025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:28:44.050025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0641e731-c003-43d1-93c6-072ca2542d9f could not be found. Jun 27 21:28:44.050025 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 27 21:28:44.052157 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6a6a3f07-f433-4616-ab6d-0f3b127ea378 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Returning 404 to user: Instance 0641e731-c003-43d1-93c6-072ca2542d9f could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:28:44.052157 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6a6a3f07-f433-4616-ab6d-0f3b127ea378 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f" status: 404 len: 111 microversion: 2.1 time: 0.056358 Jun 27 21:28:44.052157 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 515/1059] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 27 21:28:43 2022] GET /compute/v2.1/servers/0641e731-c003-43d1-93c6-072ca2542d9f => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:28:45.493602 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ebfcf38c-ebe9-4158-a0f5-e7da4f079466 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] Calling method '.version_select at 0x7f834f42f280>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:45.534056 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ebfcf38c-ebe9-4158-a0f5-e7da4f079466 tempest-TestVolumeBootPattern-1678295548 tempest-TestVolumeBootPattern-1678295548-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-621371235" status: 202 len: 0 microversion: 2.1 time: 0.050318 Jun 27 21:28:45.534692 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 545/1060] 10.222.0.13 () {58 vars in 1259 bytes} [Mon Jun 27 21:28:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-621371235 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:29:20.579503 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 21:29:20.580282 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Mon Jun 27 21:29:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 21:29:30.157832 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 21:29:30.158534 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Mon Jun 27 21:29:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 21:31:06.174640 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 21:31:06.175087 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Mon Jun 27 21:31:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 21:31:19.961311 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 21:31:19.961916 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Mon Jun 27 21:31:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 21:31:21.440640 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 21:31:21.441377 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Mon Jun 27 21:31:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 21:31:24.140191 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 21:31:24.140833 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Mon Jun 27 21:31:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 21:32:40.589186 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 21:32:40.590002 dv-cinder-847732-1-iscsi devstack@n-api.service[117891]: Mon Jun 27 21:32:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 21:32:50.169664 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 21:32:50.170313 dv-cinder-847732-1-iscsi devstack@n-api.service[117889]: Mon Jun 27 21:32:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!